Events

Time	Namespace	Component	RelatedObject	Reason	Message
00:26:28	openshift-cluster-node-tuning-operator		tuned-9mfzm	Scheduled	Successfully assigned openshift-cluster-node-tuning-operator/tuned-9mfzm to ip-10-0-134-148.us-west-1.compute.internal
01:01:36	openshift-ingress		payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp to ip-10-0-129-234.us-west-1.compute.internal
00:52:41	openshift-ingress		payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v to ip-10-0-134-148.us-west-1.compute.internal
00:34:04	kuadrant-system		authorino-56c6c9ddd5-zvqfw	Scheduled	Successfully assigned kuadrant-system/authorino-56c6c9ddd5-zvqfw to ip-10-0-134-148.us-west-1.compute.internal
00:54:46	openshift-ingress		payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2 to ip-10-0-129-234.us-west-1.compute.internal
00:51:08	openshift-ingress		payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q to ip-10-0-129-234.us-west-1.compute.internal
00:53:54	openshift-ingress		payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd to ip-10-0-129-234.us-west-1.compute.internal
00:52:57	openshift-ingress		payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl to ip-10-0-129-234.us-west-1.compute.internal
00:53:46	openshift-ingress		payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b to ip-10-0-129-234.us-west-1.compute.internal
00:59:23	openshift-ingress		payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb to ip-10-0-134-148.us-west-1.compute.internal
00:39:34	openshift-ingress		payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k to ip-10-0-129-234.us-west-1.compute.internal
00:39:36	openshift-ingress		payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh to ip-10-0-129-234.us-west-1.compute.internal
00:34:03	kuadrant-system		authorino-57f7f8659f-gjz2s	Scheduled	Successfully assigned kuadrant-system/authorino-57f7f8659f-gjz2s to ip-10-0-131-66.us-west-1.compute.internal
00:39:39	openshift-ingress		payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn to ip-10-0-134-148.us-west-1.compute.internal
00:55:58	openshift-ingress		payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx to ip-10-0-129-234.us-west-1.compute.internal
01:59:52	openshift-ingress		payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq to ip-10-0-129-234.us-west-1.compute.internal
00:37:11	openshift-ingress		payload-pre-processing-7b98bb678c-pgcrl	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-pgcrl to ip-10-0-134-148.us-west-1.compute.internal
01:18:37	openshift-ingress		payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl to ip-10-0-131-66.us-west-1.compute.internal
00:39:48	openshift-ingress		payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj to ip-10-0-129-234.us-west-1.compute.internal
02:09:55	openshift-ingress		payload-pre-processing-78b8657c54-mttsl	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-78b8657c54-mttsl to ip-10-0-134-148.us-west-1.compute.internal
02:34:12	openshift-ingress		payload-pre-processing-679f4c6c7c-pqr5j	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:35:45	kuadrant-system		authorino-6745b67544-cvsbp	Scheduled	Successfully assigned kuadrant-system/authorino-6745b67544-cvsbp to ip-10-0-134-148.us-west-1.compute.internal
02:10:25	openshift-ingress		payload-pre-processing-679f4c6c7c-phs2x	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-679f4c6c7c-phs2x to ip-10-0-134-148.us-west-1.compute.internal
01:29:44	openshift-ingress		payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2 to ip-10-0-129-234.us-west-1.compute.internal
01:33:05	openshift-ingress		payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj to ip-10-0-131-66.us-west-1.compute.internal
01:24:52	openshift-ingress		payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c to ip-10-0-131-66.us-west-1.compute.internal
01:26:19	openshift-ingress		payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx to ip-10-0-134-148.us-west-1.compute.internal
02:34:11	openshift-ingress		openshift-ai-inference-openshift-ai-inference-597546666c-nwk5r	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:26:14	openshift-ingress		payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc to ip-10-0-134-148.us-west-1.compute.internal
01:26:04	openshift-ingress		payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv to ip-10-0-131-66.us-west-1.compute.internal
00:38:41	kuadrant-system		authorino-6f48f74795-6sh8x	Scheduled	Successfully assigned kuadrant-system/authorino-6f48f74795-6sh8x to ip-10-0-134-148.us-west-1.compute.internal
00:32:49	openshift-ingress		openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	Scheduled	Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt to ip-10-0-134-148.us-west-1.compute.internal
01:27:33	openshift-ingress		payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh to ip-10-0-131-66.us-west-1.compute.internal
01:29:04	openshift-ingress		payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc to ip-10-0-129-234.us-west-1.compute.internal
01:35:14	openshift-ingress		payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr to ip-10-0-131-66.us-west-1.compute.internal
01:33:58	openshift-ingress		payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67 to ip-10-0-129-234.us-west-1.compute.internal
01:34:12	openshift-ingress		payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7 to ip-10-0-131-66.us-west-1.compute.internal
01:38:20	openshift-ingress		payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq to ip-10-0-131-66.us-west-1.compute.internal
02:34:11	kuadrant-system		authorino-6f48f74795-w4zvt	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:43:24	openshift-ingress		payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk to ip-10-0-129-234.us-west-1.compute.internal
01:41:21	openshift-ingress		payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb to ip-10-0-131-66.us-west-1.compute.internal
00:35:44	kuadrant-system		authorino-6f6944bcdd-p2rx5	Scheduled	Successfully assigned kuadrant-system/authorino-6f6944bcdd-p2rx5 to ip-10-0-134-148.us-west-1.compute.internal
01:46:27	openshift-ingress		payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh to ip-10-0-131-66.us-west-1.compute.internal
01:36:59	openshift-ingress		payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf to ip-10-0-131-66.us-west-1.compute.internal
00:59:53	openshift-ingress		payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx to ip-10-0-134-148.us-west-1.compute.internal
00:57:09	openshift-ingress		payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc to ip-10-0-134-148.us-west-1.compute.internal
01:03:23	openshift-ingress		payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm to ip-10-0-131-66.us-west-1.compute.internal
00:59:55	openshift-ingress		payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f to ip-10-0-129-234.us-west-1.compute.internal
01:03:03	openshift-ingress		payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp to ip-10-0-129-234.us-west-1.compute.internal
00:59:43	openshift-ingress		payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47 to ip-10-0-129-234.us-west-1.compute.internal
00:35:44	kuadrant-system		authorino-bd5b784c4-wpl7c	Scheduled	Successfully assigned kuadrant-system/authorino-bd5b784c4-wpl7c to ip-10-0-134-148.us-west-1.compute.internal
00:58:04	openshift-ingress		payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr to ip-10-0-129-234.us-west-1.compute.internal
01:00:35	openshift-ingress		payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj to ip-10-0-129-234.us-west-1.compute.internal
01:05:32	openshift-ingress		payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49 to ip-10-0-129-234.us-west-1.compute.internal
01:02:03	openshift-ingress		payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf to ip-10-0-129-234.us-west-1.compute.internal
00:59:59	openshift-ingress		payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2 to ip-10-0-129-234.us-west-1.compute.internal
02:34:12	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-xgdjg	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:03:50	openshift-ingress		payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7 to ip-10-0-134-148.us-west-1.compute.internal
01:07:03	openshift-ingress		payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk to ip-10-0-129-234.us-west-1.compute.internal
02:34:13	kuadrant-system		authorino-operator-7b7bb4bc77-bwqw9	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:33:43	kuadrant-system		authorino-operator-7b7bb4bc77-zr6mf	Scheduled	Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-zr6mf to ip-10-0-134-148.us-west-1.compute.internal
01:02:30	openshift-ingress		payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb to ip-10-0-129-234.us-west-1.compute.internal
00:59:19	openshift-ingress		payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw to ip-10-0-134-148.us-west-1.compute.internal
02:02:28	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-wq4dx to ip-10-0-129-234.us-west-1.compute.internal
02:34:11	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-vldr9	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:38:37	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-td7wh	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-td7wh to ip-10-0-129-234.us-west-1.compute.internal
00:39:29	openshift-ingress		payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk to ip-10-0-129-234.us-west-1.compute.internal
01:26:08	openshift-ingress		e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	Scheduled	Successfully assigned openshift-ingress/e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf to ip-10-0-131-66.us-west-1.compute.internal
01:34:15	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-pl9jb to ip-10-0-134-148.us-west-1.compute.internal
01:24:44	openshift-ingress		e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	Scheduled	Successfully assigned openshift-ingress/e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv to ip-10-0-131-66.us-west-1.compute.internal
01:43:33	openshift-ingress		payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb to ip-10-0-131-66.us-west-1.compute.internal
00:50:15	openshift-ingress		payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck to ip-10-0-129-234.us-west-1.compute.internal
00:55:21	openshift-ingress		payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr to ip-10-0-129-234.us-west-1.compute.internal
00:26:29	openshift-multus		multus-cxrhl	Scheduled	Successfully assigned openshift-multus/multus-cxrhl to ip-10-0-131-66.us-west-1.compute.internal
00:26:28	openshift-multus		multus-mw7mj	Scheduled	Successfully assigned openshift-multus/multus-mw7mj to ip-10-0-134-148.us-west-1.compute.internal
01:32:57	openshift-ingress		e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	Scheduled	Successfully assigned openshift-ingress/e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g to ip-10-0-131-66.us-west-1.compute.internal
01:33:30	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-p79k2 to ip-10-0-131-66.us-west-1.compute.internal
00:26:29	openshift-multus		network-metrics-daemon-2vxt5	Scheduled	Successfully assigned openshift-multus/network-metrics-daemon-2vxt5 to ip-10-0-131-66.us-west-1.compute.internal
00:26:28	openshift-multus		multus-additional-cni-plugins-wcpdn	Scheduled	Successfully assigned openshift-multus/multus-additional-cni-plugins-wcpdn to ip-10-0-134-148.us-west-1.compute.internal
02:34:11	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-mn7vh	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:44:55	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-kpl6n to ip-10-0-134-148.us-west-1.compute.internal
02:01:28	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-jll62	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-jll62 to ip-10-0-129-234.us-west-1.compute.internal
01:11:58	openshift-ingress		payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h to ip-10-0-129-234.us-west-1.compute.internal
01:03:45	openshift-ingress		payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr to ip-10-0-134-148.us-west-1.compute.internal
01:03:58	openshift-ingress		payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k to ip-10-0-134-148.us-west-1.compute.internal
01:05:33	openshift-ingress		payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2 to ip-10-0-129-234.us-west-1.compute.internal
01:06:50	openshift-ingress		payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd to ip-10-0-134-148.us-west-1.compute.internal
01:06:28	openshift-ingress		payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r to ip-10-0-134-148.us-west-1.compute.internal
01:06:10	openshift-ingress		payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9 to ip-10-0-134-148.us-west-1.compute.internal
02:34:11	kuadrant-system		dns-operator-controller-manager-8557cbdb84-489f6	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:33:40	kuadrant-system		dns-operator-controller-manager-8557cbdb84-9m7mp	Scheduled	Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-9m7mp to ip-10-0-134-148.us-west-1.compute.internal
01:07:59	openshift-ingress		payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh to ip-10-0-131-66.us-west-1.compute.internal
01:09:36	openshift-ingress		payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp to ip-10-0-131-66.us-west-1.compute.internal
01:13:41	openshift-ingress		payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h to ip-10-0-129-234.us-west-1.compute.internal
01:38:17	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-jfkxg to ip-10-0-134-148.us-west-1.compute.internal
01:46:47	openshift-ingress		payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts to ip-10-0-129-234.us-west-1.compute.internal
01:29:35	openshift-ingress		e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	Scheduled	Successfully assigned openshift-ingress/e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b to ip-10-0-129-234.us-west-1.compute.internal
01:26:06	openshift-ingress		e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	Scheduled	Successfully assigned openshift-ingress/e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq to ip-10-0-129-234.us-west-1.compute.internal
01:13:45	openshift-ingress		payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd to ip-10-0-129-234.us-west-1.compute.internal
00:39:28	openshift-ingress		e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	Scheduled	Successfully assigned openshift-ingress/e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2 to ip-10-0-134-148.us-west-1.compute.internal
01:18:20	openshift-ingress		payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt to ip-10-0-129-234.us-west-1.compute.internal
01:14:15	openshift-ingress		payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh to ip-10-0-134-148.us-west-1.compute.internal
01:14:22	openshift-ingress		payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2 to ip-10-0-134-148.us-west-1.compute.internal
00:26:28	openshift-multus		network-metrics-daemon-gqvhh	Scheduled	Successfully assigned openshift-multus/network-metrics-daemon-gqvhh to ip-10-0-134-148.us-west-1.compute.internal
01:25:55	openshift-ingress		e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	Scheduled	Successfully assigned openshift-ingress/e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn to ip-10-0-129-234.us-west-1.compute.internal
00:26:36	openshift-multus		network-metrics-daemon-jw8gx	Scheduled	Successfully assigned openshift-multus/network-metrics-daemon-jw8gx to ip-10-0-129-234.us-west-1.compute.internal
01:15:57	openshift-ingress		payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs to ip-10-0-129-234.us-west-1.compute.internal
01:18:28	openshift-ingress		e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	Scheduled	Successfully assigned openshift-ingress/e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp to ip-10-0-131-66.us-west-1.compute.internal
00:26:29	openshift-multus		multus-additional-cni-plugins-mf6df	Scheduled	Successfully assigned openshift-multus/multus-additional-cni-plugins-mf6df to ip-10-0-131-66.us-west-1.compute.internal
01:20:50	openshift-ingress		payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c to ip-10-0-129-234.us-west-1.compute.internal
00:55:47	openshift-ingress		e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-ee0d47-openshift-default-5b96858985-n284q to ip-10-0-129-234.us-west-1.compute.internal
00:34:01	kuadrant-system		kuadrant-console-plugin-66c4fb575d-ngn8q	Scheduled	Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-ngn8q to ip-10-0-131-66.us-west-1.compute.internal
01:16:23	openshift-ingress		payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6 to ip-10-0-129-234.us-west-1.compute.internal
01:16:32	openshift-ingress		payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7 to ip-10-0-129-234.us-west-1.compute.internal
02:05:09	openshift-ingress		payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5 to ip-10-0-129-234.us-west-1.compute.internal
02:17:47	openshift-ingress		payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl to ip-10-0-134-148.us-west-1.compute.internal
00:40:53	openshift-ingress		payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p to ip-10-0-129-234.us-west-1.compute.internal
01:27:24	openshift-ingress		e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Scheduled	Successfully assigned openshift-ingress/e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv to ip-10-0-129-234.us-west-1.compute.internal
02:34:12	kuadrant-system		kuadrant-console-plugin-66c4fb575d-qlttz	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:02:28	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-ht7vt to ip-10-0-134-148.us-west-1.compute.internal
00:38:22	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-h59pc	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-h59pc to ip-10-0-131-66.us-west-1.compute.internal
00:38:37	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-gjtnr to ip-10-0-131-66.us-west-1.compute.internal
00:33:49	kuadrant-system		kuadrant-operator-controller-manager-678d87766f-7kk5k	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7kk5k to ip-10-0-134-148.us-west-1.compute.internal
00:44:55	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-gdtdr to ip-10-0-129-234.us-west-1.compute.internal
00:32:49	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-gbc5r to ip-10-0-134-148.us-west-1.compute.internal
00:41:30	openshift-ingress		payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg to ip-10-0-134-148.us-west-1.compute.internal
00:41:22	openshift-ingress		payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz to ip-10-0-134-148.us-west-1.compute.internal
02:02:43	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-ftq6n to ip-10-0-129-234.us-west-1.compute.internal
00:55:36	openshift-ingress		e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46 to ip-10-0-129-234.us-west-1.compute.internal
02:21:54	kuadrant-system		kuadrant-operator-controller-manager-678d87766f-9fr6h	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-9fr6h to ip-10-0-134-148.us-west-1.compute.internal
00:26:36	openshift-multus		multus-additional-cni-plugins-2ckv6	Scheduled	Successfully assigned openshift-multus/multus-additional-cni-plugins-2ckv6 to ip-10-0-129-234.us-west-1.compute.internal
00:40:50	openshift-ingress		payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf to ip-10-0-134-148.us-west-1.compute.internal
02:02:43	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-fr8bl to ip-10-0-131-66.us-west-1.compute.internal
02:34:12	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-dzhvl	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:28:56	openshift-ingress		e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	Scheduled	Successfully assigned openshift-ingress/e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv to ip-10-0-131-66.us-west-1.compute.internal
00:26:36	openshift-multus		multus-4rhrt	Scheduled	Successfully assigned openshift-multus/multus-4rhrt to ip-10-0-129-234.us-west-1.compute.internal
02:34:11	kuadrant-system		kuadrant-operator-controller-manager-678d87766f-v7q9j	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:40:48	openshift-ingress		payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh to ip-10-0-134-148.us-west-1.compute.internal
01:35:04	openshift-ingress		e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4 to ip-10-0-129-234.us-west-1.compute.internal
01:01:28	openshift-ingress		e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt to ip-10-0-129-234.us-west-1.compute.internal
00:27:45	openshift-monitoring		thanos-querier-5dbf58b5cd-c6sjm	Scheduled	Successfully assigned openshift-monitoring/thanos-querier-5dbf58b5cd-c6sjm to ip-10-0-129-234.us-west-1.compute.internal
00:26:58	openshift-service-ca-operator		service-ca-operator-544d749c8c-bkjl8	Scheduled	Successfully assigned openshift-service-ca-operator/service-ca-operator-544d749c8c-bkjl8 to ip-10-0-134-148.us-west-1.compute.internal
00:22:32	openshift-service-ca-operator		service-ca-operator-544d749c8c-bkjl8	FailedScheduling	no nodes available to schedule pods
00:34:01	kuadrant-system		limitador-limitador-74dfcfb894-66m6m	Scheduled	Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-66m6m to ip-10-0-129-234.us-west-1.compute.internal
01:34:15	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-dqmwg to ip-10-0-129-234.us-west-1.compute.internal
00:37:11	openshift-ingress		payload-processing-55fbbbf9dc-29gp8	Scheduled	Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-29gp8 to ip-10-0-134-148.us-west-1.compute.internal
02:01:28	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-cldnc	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-cldnc to ip-10-0-129-234.us-west-1.compute.internal
02:10:10	openshift-ingress		payload-processing-6cdffb9d78-6qjf8	Scheduled	Successfully assigned openshift-ingress/payload-processing-6cdffb9d78-6qjf8 to ip-10-0-129-234.us-west-1.compute.internal
02:10:24	openshift-ingress		payload-processing-6dfc49d895-nvznf	Scheduled	Successfully assigned openshift-ingress/payload-processing-6dfc49d895-nvznf to ip-10-0-129-234.us-west-1.compute.internal
01:59:52	openshift-ingress		payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj to ip-10-0-129-234.us-west-1.compute.internal
00:39:39	openshift-ingress		payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg to ip-10-0-134-148.us-west-1.compute.internal
01:34:15	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-btqmg	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-btqmg to ip-10-0-131-66.us-west-1.compute.internal
00:34:04	kuadrant-system		limitador-limitador-7c9b87d574-9jgw7	Scheduled	Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-9jgw7 to ip-10-0-131-66.us-west-1.compute.internal
00:39:36	openshift-ingress		payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5 to ip-10-0-129-234.us-west-1.compute.internal
02:02:28	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-b5rh5 to ip-10-0-134-148.us-west-1.compute.internal
00:38:37	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-9cx9g to ip-10-0-134-148.us-west-1.compute.internal
00:39:34	openshift-ingress		payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh to ip-10-0-134-148.us-west-1.compute.internal
00:59:24	openshift-ingress		payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p to ip-10-0-134-148.us-west-1.compute.internal
00:22:30	openshift-service-ca-operator		service-ca-operator-544d749c8c-bkjl8	FailedScheduling	no nodes available to schedule pods
02:34:13	kuadrant-system		limitador-limitador-7c9b87d574-rvx7r	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:38:17	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-8qhvg to ip-10-0-129-234.us-west-1.compute.internal
02:34:12	openshift-service-ca-operator		service-ca-operator-544d749c8c-5bwfp	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:53:47	openshift-ingress		payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n to ip-10-0-129-234.us-west-1.compute.internal
02:02:28	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 to ip-10-0-131-66.us-west-1.compute.internal
00:52:57	openshift-ingress		payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc to ip-10-0-129-234.us-west-1.compute.internal
00:33:36	kuadrant-system		limitador-operator-controller-manager-5778bb4449-7hsnc	Scheduled	Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-7hsnc to ip-10-0-134-148.us-west-1.compute.internal
01:33:30	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-7lvhw to ip-10-0-134-148.us-west-1.compute.internal
00:44:55	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-7krwg to ip-10-0-131-66.us-west-1.compute.internal
00:53:54	openshift-ingress		payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76 to ip-10-0-129-234.us-west-1.compute.internal
01:33:00	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-6cf6c to ip-10-0-131-66.us-west-1.compute.internal
02:34:11	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-5k49j	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:33:49	openshift-ingress		e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv to ip-10-0-131-66.us-west-1.compute.internal
00:29:03	openshift-monitoring		telemeter-client-5d5dd7655d-nknlw	Scheduled	Successfully assigned openshift-monitoring/telemeter-client-5d5dd7655d-nknlw to ip-10-0-129-234.us-west-1.compute.internal
02:34:13	kuadrant-system		limitador-operator-controller-manager-5778bb4449-v9f8f	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:44:55	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-596nd	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-596nd to ip-10-0-134-148.us-west-1.compute.internal
01:34:04	openshift-ingress		e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb to ip-10-0-129-234.us-west-1.compute.internal
00:51:08	openshift-ingress		payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw to ip-10-0-129-234.us-west-1.compute.internal
00:38:22	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-4wnxp to ip-10-0-129-234.us-west-1.compute.internal
02:34:13	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-4k5mv	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:27:30	openshift-monitoring		prometheus-operator-admission-webhook-6489d8bf89-cnzm7	Scheduled	Successfully assigned openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-cnzm7 to ip-10-0-129-234.us-west-1.compute.internal
01:38:12	openshift-ingress		e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp to ip-10-0-131-66.us-west-1.compute.internal
00:27:35	openshift-monitoring		prometheus-operator-9cd89b74c-zw4f5	Scheduled	Successfully assigned openshift-monitoring/prometheus-operator-9cd89b74c-zw4f5 to ip-10-0-131-66.us-west-1.compute.internal
00:44:55	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-4fnf7 to ip-10-0-134-148.us-west-1.compute.internal
02:34:12	openshift-monitoring		prometheus-operator-9cd89b74c-hpcfw	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:34:12	openshift-monitoring		prometheus-k8s-0	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:54:46	openshift-ingress		payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2 to ip-10-0-129-234.us-west-1.compute.internal
01:38:17	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-44k5r to ip-10-0-129-234.us-west-1.compute.internal
00:27:08	openshift-service-ca		service-ca-5fffc97bdf-9jbck	Scheduled	Successfully assigned openshift-service-ca/service-ca-5fffc97bdf-9jbck to ip-10-0-129-234.us-west-1.compute.internal
01:43:16	openshift-ingress		e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd to ip-10-0-131-66.us-west-1.compute.internal
00:29:06	openshift-monitoring		prometheus-k8s-0	Scheduled	Successfully assigned openshift-monitoring/prometheus-k8s-0 to ip-10-0-131-66.us-west-1.compute.internal
01:41:12	openshift-ingress		e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb to ip-10-0-129-234.us-west-1.compute.internal
01:46:16	openshift-ingress		e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26 to ip-10-0-129-234.us-west-1.compute.internal
00:27:52	openshift-monitoring		prometheus-k8s-0	Scheduled	Successfully assigned openshift-monitoring/prometheus-k8s-0 to ip-10-0-131-66.us-west-1.compute.internal
00:37:03	opendatahub		ai-gateway-controller-7d85675f98-smrj6	Scheduled	Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-smrj6 to ip-10-0-134-148.us-west-1.compute.internal
00:52:41	openshift-ingress		payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2 to ip-10-0-134-148.us-west-1.compute.internal
02:01:28	openshift-ingress		maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-2s8jj to ip-10-0-134-148.us-west-1.compute.internal
00:33:59	openshift-ingress		kube-auth-proxy-5d55d55f6d-xsfmv	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-5d55d55f6d-xsfmv to ip-10-0-129-234.us-west-1.compute.internal
02:34:13	openshift-ingress		kube-auth-proxy-5d55d55f6d-ltxrk	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:33:59	openshift-ingress		kube-auth-proxy-5d55d55f6d-h897p	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-5d55d55f6d-h897p to ip-10-0-131-66.us-west-1.compute.internal
01:01:36	openshift-ingress		payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq to ip-10-0-129-234.us-west-1.compute.internal
00:55:49	openshift-ingress		payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9 to ip-10-0-129-234.us-west-1.compute.internal
00:55:59	openshift-ingress		payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt to ip-10-0-129-234.us-west-1.compute.internal
02:34:12	opendatahub		ai-gateway-controller-8967cc4f-khgds	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:37:18	opendatahub		ai-gateway-controller-8967cc4f-x2fc2	Scheduled	Successfully assigned opendatahub/ai-gateway-controller-8967cc4f-x2fc2 to ip-10-0-134-148.us-west-1.compute.internal
01:16:47	openshift-ingress		istiod-openshift-gateway-7ddd9cfdc8-jnjb8	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jnjb8 to ip-10-0-134-148.us-west-1.compute.internal
00:50:35	openshift-ingress		istiod-openshift-gateway-7ddd9cfdc8-g8m28	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-g8m28 to ip-10-0-134-148.us-west-1.compute.internal
00:35:13	openshift-ingress		istiod-openshift-gateway-7ddd9cfdc8-9s6rb	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9s6rb to ip-10-0-129-234.us-west-1.compute.internal
00:32:42	openshift-ingress		istiod-openshift-gateway-7876bfcb74-ssc2x	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-ssc2x to ip-10-0-129-234.us-west-1.compute.internal
01:18:37	openshift-ingress		payload-processing-e2e-autores-334c6a-65568666f7-84f5v	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-autores-334c6a-65568666f7-84f5v to ip-10-0-131-66.us-west-1.compute.internal
00:52:32	openshift-ingress		e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr to ip-10-0-129-234.us-west-1.compute.internal
01:36:49	openshift-ingress		e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg to ip-10-0-131-66.us-west-1.compute.internal
00:39:48	openshift-ingress		payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl to ip-10-0-134-148.us-west-1.compute.internal
00:27:43	openshift-monitoring		openshift-state-metrics-7bd7489957-jnhj4	Scheduled	Successfully assigned openshift-monitoring/openshift-state-metrics-7bd7489957-jnhj4 to ip-10-0-129-234.us-west-1.compute.internal
01:29:44	openshift-ingress		payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd to ip-10-0-129-234.us-west-1.compute.internal
01:33:05	openshift-ingress		payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q to ip-10-0-129-234.us-west-1.compute.internal
01:24:52	openshift-ingress		payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc to ip-10-0-131-66.us-west-1.compute.internal
01:26:19	openshift-ingress		payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj to ip-10-0-129-234.us-west-1.compute.internal
01:26:14	openshift-ingress		payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl to ip-10-0-134-148.us-west-1.compute.internal
00:35:19	opendatahub		kserve-controller-manager-776cc66d47-cpp7f	Scheduled	Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-cpp7f to ip-10-0-134-148.us-west-1.compute.internal
01:26:04	openshift-ingress		payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq to ip-10-0-131-66.us-west-1.compute.internal
01:27:32	openshift-ingress		payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl to ip-10-0-131-66.us-west-1.compute.internal
01:29:04	openshift-ingress		payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj to ip-10-0-129-234.us-west-1.compute.internal
01:35:14	openshift-ingress		payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r to ip-10-0-131-66.us-west-1.compute.internal
01:33:58	openshift-ingress		payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k to ip-10-0-129-234.us-west-1.compute.internal
00:57:01	openshift-ingress		e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5 to ip-10-0-131-66.us-west-1.compute.internal
00:59:45	openshift-ingress		e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz to ip-10-0-131-66.us-west-1.compute.internal
02:34:11	opendatahub		kserve-controller-manager-776cc66d47-qjj9n	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:34:12	openshift-ingress		payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz to ip-10-0-129-234.us-west-1.compute.internal
00:27:43	openshift-monitoring		node-exporter-qxqvx	Scheduled	Successfully assigned openshift-monitoring/node-exporter-qxqvx to ip-10-0-129-234.us-west-1.compute.internal
01:38:21	openshift-ingress		payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z to ip-10-0-131-66.us-west-1.compute.internal
01:43:25	openshift-ingress		payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf to ip-10-0-131-66.us-west-1.compute.internal
02:34:12	opendatahub		kserve-module-controller-manager-7566cf5fc8-mlbt7	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:34:11	opendatahub		kserve-module-controller-manager-7566cf5fc8-s59js	Scheduled	Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-s59js to ip-10-0-134-148.us-west-1.compute.internal
01:41:22	openshift-ingress		payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4 to ip-10-0-131-66.us-west-1.compute.internal
01:46:27	openshift-ingress		payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv to ip-10-0-131-66.us-west-1.compute.internal
01:36:59	openshift-ingress		payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86 to ip-10-0-131-66.us-west-1.compute.internal
00:57:10	openshift-ingress		payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j to ip-10-0-134-148.us-west-1.compute.internal
00:59:54	openshift-ingress		payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w to ip-10-0-134-148.us-west-1.compute.internal
00:59:34	openshift-ingress		e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw to ip-10-0-131-66.us-west-1.compute.internal
00:57:56	openshift-ingress		e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4 to ip-10-0-131-66.us-west-1.compute.internal
00:59:54	openshift-ingress		payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj to ip-10-0-129-234.us-west-1.compute.internal
01:01:54	openshift-ingress		e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg to ip-10-0-129-234.us-west-1.compute.internal
01:14:22	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw to ip-10-0-131-66.us-west-1.compute.internal
00:49:41	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj to ip-10-0-129-234.us-west-1.compute.internal
01:03:24	openshift-ingress		payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c to ip-10-0-129-234.us-west-1.compute.internal
01:03:04	openshift-ingress		payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx to ip-10-0-131-66.us-west-1.compute.internal
00:36:29	opendatahub		llmisvc-controller-manager-6466c554d8-g82lt	Scheduled	Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-g82lt to ip-10-0-131-66.us-west-1.compute.internal
00:59:43	openshift-ingress		payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz to ip-10-0-129-234.us-west-1.compute.internal
01:54:53	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r to ip-10-0-129-234.us-west-1.compute.internal
01:00:36	openshift-ingress		payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb to ip-10-0-131-66.us-west-1.compute.internal
01:14:07	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5 to ip-10-0-134-148.us-west-1.compute.internal
00:40:36	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7 to ip-10-0-129-234.us-west-1.compute.internal
00:27:43	openshift-monitoring		node-exporter-865h2	Scheduled	Successfully assigned openshift-monitoring/node-exporter-865h2 to ip-10-0-134-148.us-west-1.compute.internal
02:34:10	opendatahub		llmisvc-controller-manager-6466c554d8-tqkk8	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:58:04	openshift-ingress		payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz to ip-10-0-134-148.us-west-1.compute.internal
00:59:49	openshift-ingress		e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27 to ip-10-0-129-234.us-west-1.compute.internal
00:35:19	opendatahub		llmisvc-controller-manager-869d5dcc5d-xk96l	Scheduled	Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-xk96l to ip-10-0-131-66.us-west-1.compute.internal
01:13:07	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5 to ip-10-0-131-66.us-west-1.compute.internal
01:05:33	openshift-ingress		payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx to ip-10-0-129-234.us-west-1.compute.internal
01:14:22	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4 to ip-10-0-129-234.us-west-1.compute.internal
01:02:03	openshift-ingress		payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn to ip-10-0-129-234.us-west-1.compute.internal
00:59:59	openshift-ingress		payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f to ip-10-0-129-234.us-west-1.compute.internal
01:12:06	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq to ip-10-0-131-66.us-west-1.compute.internal
00:49:41	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf to ip-10-0-131-66.us-west-1.compute.internal
01:03:50	openshift-ingress		payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5 to ip-10-0-134-148.us-west-1.compute.internal
01:07:03	openshift-ingress		payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7 to ip-10-0-129-234.us-west-1.compute.internal
00:59:19	openshift-ingress		payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v to ip-10-0-129-234.us-west-1.compute.internal
01:12:52	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5 to ip-10-0-129-234.us-west-1.compute.internal
00:34:46	opendatahub		maas-controller-5d4989bfc5-5d2gd	Scheduled	Successfully assigned opendatahub/maas-controller-5d4989bfc5-5d2gd to ip-10-0-131-66.us-west-1.compute.internal
00:42:37	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x to ip-10-0-134-148.us-west-1.compute.internal
01:02:30	openshift-ingress		payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g to ip-10-0-129-234.us-west-1.compute.internal
00:39:29	openshift-ingress		payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp to ip-10-0-129-234.us-west-1.compute.internal
01:14:07	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72 to ip-10-0-129-234.us-west-1.compute.internal
01:43:33	openshift-ingress		payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4 to ip-10-0-131-66.us-west-1.compute.internal
00:55:21	openshift-ingress		payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw to ip-10-0-129-234.us-west-1.compute.internal
01:14:22	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44 to ip-10-0-134-148.us-west-1.compute.internal
00:50:15	openshift-ingress		payload-processing-e2e-mt-ef1f397c-696fb75475-thz58	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-mt-ef1f397c-696fb75475-thz58 to ip-10-0-129-234.us-west-1.compute.internal
02:34:13	opendatahub		maas-controller-c6c5b9684-47s69	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:01:35	opendatahub		maas-controller-c6c5b9684-7w7mh	Scheduled	Successfully assigned opendatahub/maas-controller-c6c5b9684-7w7mh to ip-10-0-134-148.us-west-1.compute.internal
00:27:43	openshift-monitoring		node-exporter-7k7nh	Scheduled	Successfully assigned openshift-monitoring/node-exporter-7k7nh to ip-10-0-131-66.us-west-1.compute.internal
02:34:11	openshift-monitoring		monitoring-plugin-77f4f76594-xtpk9	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:03:38	openshift-ingress		e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5 to ip-10-0-129-234.us-west-1.compute.internal
00:27:48	openshift-monitoring		monitoring-plugin-77f4f76594-dbkds	Scheduled	Successfully assigned openshift-monitoring/monitoring-plugin-77f4f76594-dbkds to ip-10-0-131-66.us-west-1.compute.internal
00:27:48	openshift-monitoring		metrics-server-547554f588-2ksph	Scheduled	Successfully assigned openshift-monitoring/metrics-server-547554f588-2ksph to ip-10-0-129-234.us-west-1.compute.internal
00:59:10	openshift-ingress		e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm to ip-10-0-131-66.us-west-1.compute.internal
00:54:37	openshift-ingress		e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7 to ip-10-0-129-234.us-west-1.compute.internal
02:00:57	opendatahub		maas-controller-c6c5b9684-j6gz2	Scheduled	Successfully assigned opendatahub/maas-controller-c6c5b9684-j6gz2 to ip-10-0-134-148.us-west-1.compute.internal
00:39:21	openshift-ingress		e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	Scheduled	Successfully assigned openshift-ingress/e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm to ip-10-0-134-148.us-west-1.compute.internal
01:43:25	openshift-ingress		e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	Scheduled	Successfully assigned openshift-ingress/e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5 to ip-10-0-129-234.us-west-1.compute.internal
00:27:43	openshift-monitoring		kube-state-metrics-5dc8d7d89b-m4669	Scheduled	Successfully assigned openshift-monitoring/kube-state-metrics-5dc8d7d89b-m4669 to ip-10-0-129-234.us-west-1.compute.internal
00:56:54	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x to ip-10-0-131-66.us-west-1.compute.internal
00:56:54	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj to ip-10-0-134-148.us-west-1.compute.internal
00:26:28	openshift-ovn-kubernetes		ovnkube-node-wlldw	Scheduled	Successfully assigned openshift-ovn-kubernetes/ovnkube-node-wlldw to ip-10-0-134-148.us-west-1.compute.internal
00:34:46	opendatahub		maas-controller-c6c5b9684-jdd2p	Scheduled	Successfully assigned opendatahub/maas-controller-c6c5b9684-jdd2p to ip-10-0-131-66.us-west-1.compute.internal
01:12:52	openshift-ingress		e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn to ip-10-0-134-148.us-west-1.compute.internal
01:11:58	openshift-ingress		payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm to ip-10-0-129-234.us-west-1.compute.internal
01:03:45	openshift-ingress		payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc to ip-10-0-134-148.us-west-1.compute.internal
01:03:58	openshift-ingress		payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm to ip-10-0-134-148.us-west-1.compute.internal
01:05:33	openshift-ingress		payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz to ip-10-0-129-234.us-west-1.compute.internal
00:56:39	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k to ip-10-0-129-234.us-west-1.compute.internal
01:06:50	openshift-ingress		payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx to ip-10-0-129-234.us-west-1.compute.internal
00:56:54	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88 to ip-10-0-129-234.us-west-1.compute.internal
00:56:39	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f to ip-10-0-131-66.us-west-1.compute.internal
00:50:05	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j to ip-10-0-134-148.us-west-1.compute.internal
00:57:09	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw to ip-10-0-134-148.us-west-1.compute.internal
00:56:54	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk to ip-10-0-131-66.us-west-1.compute.internal
01:06:28	openshift-ingress		payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt to ip-10-0-134-148.us-west-1.compute.internal
00:56:39	openshift-ingress		e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w to ip-10-0-129-234.us-west-1.compute.internal
01:06:10	openshift-ingress		payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf to ip-10-0-134-148.us-west-1.compute.internal
01:23:26	openshift-ingress		e2e-noten-f24360-openshift-default-c677fb987-m6z6w	Scheduled	Successfully assigned openshift-ingress/e2e-noten-f24360-openshift-default-c677fb987-m6z6w to ip-10-0-134-148.us-west-1.compute.internal
01:08:00	openshift-ingress		payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft to ip-10-0-129-234.us-west-1.compute.internal
01:11:50	openshift-ingress		e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m to ip-10-0-129-234.us-west-1.compute.internal
00:50:58	openshift-ingress		e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4 to ip-10-0-129-234.us-west-1.compute.internal
02:34:11	opendatahub		model-serving-api-75bd89fdfc-prfv5	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:35:19	opendatahub		model-serving-api-75bd89fdfc-xm5x8	Scheduled	Successfully assigned opendatahub/model-serving-api-75bd89fdfc-xm5x8 to ip-10-0-131-66.us-west-1.compute.internal
01:09:36	openshift-ingress		payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786 to ip-10-0-131-66.us-west-1.compute.internal
01:13:40	openshift-ingress		payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp to ip-10-0-129-234.us-west-1.compute.internal
01:46:47	openshift-ingress		payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l to ip-10-0-131-66.us-west-1.compute.internal
01:13:45	openshift-ingress		payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg to ip-10-0-129-234.us-west-1.compute.internal
01:18:20	openshift-ingress		payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p to ip-10-0-129-234.us-west-1.compute.internal
01:03:36	openshift-ingress		e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm to ip-10-0-131-66.us-west-1.compute.internal
01:14:15	openshift-ingress		payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j to ip-10-0-134-148.us-west-1.compute.internal
01:03:50	openshift-ingress		e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw to ip-10-0-129-234.us-west-1.compute.internal
01:14:22	openshift-ingress		payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt to ip-10-0-134-148.us-west-1.compute.internal
00:35:19	opendatahub		odh-model-controller-769875db56-mn6tc	Scheduled	Successfully assigned opendatahub/odh-model-controller-769875db56-mn6tc to ip-10-0-134-148.us-west-1.compute.internal
01:15:58	openshift-ingress		payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z to ip-10-0-131-66.us-west-1.compute.internal
01:20:50	openshift-ingress		payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26 to ip-10-0-131-66.us-west-1.compute.internal
01:16:23	openshift-ingress		payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx to ip-10-0-129-234.us-west-1.compute.internal
01:16:32	openshift-ingress		payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv to ip-10-0-129-234.us-west-1.compute.internal
02:05:09	openshift-ingress		payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd to ip-10-0-129-234.us-west-1.compute.internal
01:05:20	openshift-ingress		e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr to ip-10-0-131-66.us-west-1.compute.internal
01:06:42	openshift-ingress		e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8 to ip-10-0-131-66.us-west-1.compute.internal
02:34:11	opendatahub		odh-model-controller-769875db56-mzcn9	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:17:47	openshift-ingress		payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh to ip-10-0-134-148.us-west-1.compute.internal
00:55:49	openshift-ingress		payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq to ip-10-0-129-234.us-west-1.compute.internal
00:40:53	openshift-ingress		payload-processing-e2e-worker-w0-902076-664f4c595-qstk6	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-902076-664f4c595-qstk6 to ip-10-0-134-148.us-west-1.compute.internal
01:56:39	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4 to ip-10-0-129-234.us-west-1.compute.internal
01:24:30	opendatahub		test-curl-7460-01317b	Scheduled	Successfully assigned opendatahub/test-curl-7460-01317b to ip-10-0-134-148.us-west-1.compute.internal
01:06:20	openshift-ingress		e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w to ip-10-0-129-234.us-west-1.compute.internal
00:53:44	openshift-ingress		e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj to ip-10-0-131-66.us-west-1.compute.internal
00:26:58	openshift-monitoring		cluster-monitoring-operator-884576c57-nqmlz	Scheduled	Successfully assigned openshift-monitoring/cluster-monitoring-operator-884576c57-nqmlz to ip-10-0-134-148.us-west-1.compute.internal
00:22:32	openshift-monitoring		cluster-monitoring-operator-884576c57-nqmlz	FailedScheduling	no nodes available to schedule pods
00:22:30	openshift-monitoring		cluster-monitoring-operator-884576c57-nqmlz	FailedScheduling	no nodes available to schedule pods
01:24:33	opendatahub		test-curl-7460-22ecbc	Scheduled	Successfully assigned opendatahub/test-curl-7460-22ecbc to ip-10-0-131-66.us-west-1.compute.internal
01:06:01	openshift-ingress		e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk to ip-10-0-129-234.us-west-1.compute.internal
02:34:13	openshift-monitoring		cluster-monitoring-operator-884576c57-7sbf4	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:07:50	openshift-ingress		e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b to ip-10-0-129-234.us-west-1.compute.internal
00:52:49	openshift-ingress		e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd to ip-10-0-131-66.us-west-1.compute.internal
00:29:01	openshift-monitoring		alertmanager-main-0	Scheduled	Successfully assigned openshift-monitoring/alertmanager-main-0 to ip-10-0-129-234.us-west-1.compute.internal
01:24:36	opendatahub		test-curl-7460-2bfc55	Scheduled	Successfully assigned opendatahub/test-curl-7460-2bfc55 to ip-10-0-131-66.us-west-1.compute.internal
00:26:29	openshift-ovn-kubernetes		ovnkube-node-qmx5k	Scheduled	Successfully assigned openshift-ovn-kubernetes/ovnkube-node-qmx5k to ip-10-0-131-66.us-west-1.compute.internal
01:09:27	openshift-ingress		e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629 to ip-10-0-131-66.us-west-1.compute.internal
01:13:33	openshift-ingress		e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	Scheduled	Successfully assigned openshift-ingress/e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87 to ip-10-0-129-234.us-west-1.compute.internal
00:27:45	openshift-monitoring		alertmanager-main-0	Scheduled	Successfully assigned openshift-monitoring/alertmanager-main-0 to ip-10-0-129-234.us-west-1.compute.internal
01:46:39	openshift-ingress		e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh to ip-10-0-131-66.us-west-1.compute.internal
00:53:26	opendatahub		test-curl-7460-3512d7	Scheduled	Successfully assigned opendatahub/test-curl-7460-3512d7 to ip-10-0-129-234.us-west-1.compute.internal
00:51:13	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb to ip-10-0-131-66.us-west-1.compute.internal
00:41:30	openshift-ingress		payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96 to ip-10-0-134-148.us-west-1.compute.internal
01:14:23	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5 to ip-10-0-134-148.us-west-1.compute.internal
00:44:55	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp to ip-10-0-131-66.us-west-1.compute.internal
00:41:23	openshift-ingress		payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8 to ip-10-0-134-148.us-west-1.compute.internal
01:12:22	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc to ip-10-0-129-234.us-west-1.compute.internal
00:57:24	opendatahub		test-curl-7460-7d447c	Scheduled	Successfully assigned opendatahub/test-curl-7460-7d447c to ip-10-0-131-66.us-west-1.compute.internal
00:50:28	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb to ip-10-0-134-148.us-west-1.compute.internal
00:40:50	openshift-ingress		payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8 to ip-10-0-134-148.us-west-1.compute.internal
01:14:54	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx to ip-10-0-134-148.us-west-1.compute.internal
00:50:43	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp to ip-10-0-131-66.us-west-1.compute.internal
00:40:48	openshift-ingress		payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762 to ip-10-0-129-234.us-west-1.compute.internal
01:13:08	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr to ip-10-0-131-66.us-west-1.compute.internal
01:24:39	opendatahub		test-curl-7460-ccaebd	Scheduled	Successfully assigned opendatahub/test-curl-7460-ccaebd to ip-10-0-131-66.us-west-1.compute.internal
00:55:38	openshift-ingress		e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf to ip-10-0-134-148.us-west-1.compute.internal
01:13:36	openshift-ingress		e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn to ip-10-0-129-234.us-west-1.compute.internal
00:55:38	openshift-ingress		e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc to ip-10-0-131-66.us-west-1.compute.internal
00:26:58	openshift-kube-storage-version-migrator-operator		kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Scheduled	Successfully assigned openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h2t24 to ip-10-0-134-148.us-west-1.compute.internal
00:22:32	openshift-kube-storage-version-migrator-operator		kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	FailedScheduling	no nodes available to schedule pods
01:24:24	opendatahub		test-curl-7460-dc7350	Scheduled	Successfully assigned opendatahub/test-curl-7460-dc7350 to ip-10-0-134-148.us-west-1.compute.internal
00:22:30	openshift-kube-storage-version-migrator-operator		kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	FailedScheduling	no nodes available to schedule pods
02:34:13	openshift-kube-storage-version-migrator-operator		kube-storage-version-migrator-operator-7d4bc45dd6-97z2t	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:18:12	openshift-ingress		e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst to ip-10-0-129-234.us-west-1.compute.internal
00:53:37	openshift-ingress		e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw to ip-10-0-129-234.us-west-1.compute.internal
00:55:38	openshift-ingress		e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb to ip-10-0-129-234.us-west-1.compute.internal
00:27:06	openshift-kube-storage-version-migrator		migrator-66df5d496b-tbzhs	Scheduled	Successfully assigned openshift-kube-storage-version-migrator/migrator-66df5d496b-tbzhs to ip-10-0-131-66.us-west-1.compute.internal
01:29:03	opendatahub		test-curl-7463-f4cf17	Scheduled	Successfully assigned opendatahub/test-curl-7463-f4cf17 to ip-10-0-131-66.us-west-1.compute.internal
01:14:07	openshift-ingress		e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p to ip-10-0-129-234.us-west-1.compute.internal
00:27:06	openshift-kube-storage-version-migrator		migrator-66df5d496b-k4jqv	Scheduled	Successfully assigned openshift-kube-storage-version-migrator/migrator-66df5d496b-k4jqv to ip-10-0-134-148.us-west-1.compute.internal
02:34:11	openshift-kube-storage-version-migrator		migrator-66df5d496b-hwmkt	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:34:12	openshift-kube-storage-version-migrator		migrator-66df5d496b-b7tbt	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:59:14	openshift-ingress		e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5 to ip-10-0-129-234.us-west-1.compute.internal
01:26:01	opendatahub		test-curl-7466-190204	Scheduled	Successfully assigned opendatahub/test-curl-7466-190204 to ip-10-0-134-148.us-west-1.compute.internal
01:49:20	openshift-ingress		e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp to ip-10-0-131-66.us-west-1.compute.internal
01:15:41	openshift-ingress		e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz to ip-10-0-129-234.us-west-1.compute.internal
01:14:10	openshift-ingress		e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4 to ip-10-0-129-234.us-west-1.compute.internal
00:39:20	openshift-ingress		e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Scheduled	Successfully assigned openshift-ingress/e2e-ait-e8418376-openshift-default-5558c64d77-kvflp to ip-10-0-134-148.us-west-1.compute.internal
01:16:26	openshift-ingress		e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl to ip-10-0-134-148.us-west-1.compute.internal
01:53:13	opendatahub		test-curl-7466-97d23a	Scheduled	Successfully assigned opendatahub/test-curl-7466-97d23a to ip-10-0-131-66.us-west-1.compute.internal
00:26:36	openshift-ovn-kubernetes		ovnkube-node-gzk2m	Scheduled	Successfully assigned openshift-ovn-kubernetes/ovnkube-node-gzk2m to ip-10-0-129-234.us-west-1.compute.internal
00:39:20	openshift-ingress		e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	Scheduled	Successfully assigned openshift-ingress/e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz to ip-10-0-134-148.us-west-1.compute.internal
01:15:41	openshift-ingress		e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m to ip-10-0-134-148.us-west-1.compute.internal
01:15:41	openshift-ingress		e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2 to ip-10-0-131-66.us-west-1.compute.internal
01:16:26	openshift-ingress		e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps to ip-10-0-131-66.us-west-1.compute.internal
01:53:09	opendatahub		test-curl-7466-9d7516	Scheduled	Successfully assigned opendatahub/test-curl-7466-9d7516 to ip-10-0-131-66.us-west-1.compute.internal
00:39:22	openshift-ingress		e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	Scheduled	Successfully assigned openshift-ingress/e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k to ip-10-0-129-234.us-west-1.compute.internal
02:34:12	openshift-network-console		networking-console-plugin-86c478bb88-lrdfn	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:22:34	openshift-network-console		networking-console-plugin-86c478bb88-v4tzv	FailedScheduling	no nodes available to schedule pods
00:22:36	openshift-network-console		networking-console-plugin-86c478bb88-v4tzv	FailedScheduling	no nodes available to schedule pods
00:26:58	openshift-network-console		networking-console-plugin-86c478bb88-v4tzv	Scheduled	Successfully assigned openshift-network-console/networking-console-plugin-86c478bb88-v4tzv to ip-10-0-134-148.us-west-1.compute.internal
00:34:56	opendatahub		usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	Scheduled	Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-4ptr6 to ip-10-0-134-148.us-west-1.compute.internal
02:34:11	openshift-ingress		router-default-b48ff49b9-f25xg	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:22:30	openshift-ingress		router-default-b48ff49b9-v8tjs	FailedScheduling	no nodes available to schedule pods
00:22:32	openshift-ingress		router-default-b48ff49b9-v8tjs	FailedScheduling	no nodes available to schedule pods
00:26:58	openshift-ingress		router-default-b48ff49b9-v8tjs	Scheduled	Successfully assigned openshift-ingress/router-default-b48ff49b9-v8tjs to ip-10-0-134-148.us-west-1.compute.internal
01:59:44	openshift-ingress		e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	Scheduled	Successfully assigned openshift-ingress/e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9 to ip-10-0-129-234.us-west-1.compute.internal
02:34:12	openshift-network-diagnostics		network-check-source-6f78d59f99-7zvhb	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
01:13:53	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v to ip-10-0-129-234.us-west-1.compute.internal
00:22:30	openshift-network-diagnostics		network-check-source-6f78d59f99-knrbl	FailedScheduling	no nodes available to schedule pods
00:26:29	openshift-network-operator		iptables-alerter-zpf48	Scheduled	Successfully assigned openshift-network-operator/iptables-alerter-zpf48 to ip-10-0-131-66.us-west-1.compute.internal
02:34:11	opendatahub		usage-logs-tenancy-proxy-9c5d49bcd-l7v66	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:34:10	openshift-ingress		data-science-gateway-data-science-gateway-class-6bc49dd89-tdzrq	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:22:32	openshift-network-diagnostics		network-check-source-6f78d59f99-knrbl	FailedScheduling	no nodes available to schedule pods
00:26:58	openshift-network-diagnostics		network-check-source-6f78d59f99-knrbl	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-source-6f78d59f99-knrbl to ip-10-0-134-148.us-west-1.compute.internal
00:50:28	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n to ip-10-0-129-234.us-west-1.compute.internal
00:50:28	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w to ip-10-0-129-234.us-west-1.compute.internal
02:34:11	opendatahub-operator-system		opendatahub-operator-controller-manager-6b5d59bb59-7vj9v	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:34:13	opendatahub-operator-system		opendatahub-operator-controller-manager-6b5d59bb59-cvrqn	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:33:16	opendatahub-operator-system		opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Scheduled	Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6b5d59bb59-khdbh to ip-10-0-129-234.us-west-1.compute.internal
00:40:38	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n to ip-10-0-129-234.us-west-1.compute.internal
00:34:00	openshift-ingress		data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8 to ip-10-0-134-148.us-west-1.compute.internal
00:26:28	openshift-image-registry		node-ca-qdq6c	Scheduled	Successfully assigned openshift-image-registry/node-ca-qdq6c to ip-10-0-134-148.us-west-1.compute.internal
00:26:36	openshift-image-registry		node-ca-2l6ct	Scheduled	Successfully assigned openshift-image-registry/node-ca-2l6ct to ip-10-0-129-234.us-west-1.compute.internal
00:26:29	openshift-image-registry		node-ca-2jtx2	Scheduled	Successfully assigned openshift-image-registry/node-ca-2jtx2 to ip-10-0-131-66.us-west-1.compute.internal
00:26:58	openshift-image-registry		image-registry-dfd9f5756-s9tvc	Scheduled	Successfully assigned openshift-image-registry/image-registry-dfd9f5756-s9tvc to ip-10-0-134-148.us-west-1.compute.internal
00:22:32	openshift-image-registry		image-registry-dfd9f5756-s9tvc	FailedScheduling	no nodes available to schedule pods
00:26:59	openshift-ingress-canary		ingress-canary-9vqsh	Scheduled	Successfully assigned openshift-ingress-canary/ingress-canary-9vqsh to ip-10-0-131-66.us-west-1.compute.internal
01:14:23	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps to ip-10-0-131-66.us-west-1.compute.internal
00:22:30	openshift-image-registry		image-registry-dfd9f5756-s9tvc	FailedScheduling	no nodes available to schedule pods
00:33:16	opendatahub-operator-system		opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Scheduled	Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6b5d59bb59-n2w5c to ip-10-0-134-148.us-west-1.compute.internal
00:49:42	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9 to ip-10-0-134-148.us-west-1.compute.internal
02:34:12	openshift-image-registry		image-registry-d98c5d7fb-bq2b8	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:27:30	openshift-image-registry		image-registry-d98c5d7fb-9p5s7	Scheduled	Successfully assigned openshift-image-registry/image-registry-d98c5d7fb-9p5s7 to ip-10-0-131-66.us-west-1.compute.internal
01:15:50	openshift-ingress		e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk to ip-10-0-129-234.us-west-1.compute.internal
00:26:58	openshift-image-registry		image-registry-6c9bd86665-k87ds	Scheduled	Successfully assigned openshift-image-registry/image-registry-6c9bd86665-k87ds to ip-10-0-134-148.us-west-1.compute.internal
00:26:36	openshift-image-registry		image-registry-6c9bd86665-k87ds	FailedScheduling	0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.
00:26:58	openshift-ingress-canary		ingress-canary-bq5tp	Scheduled	Successfully assigned openshift-ingress-canary/ingress-canary-bq5tp to ip-10-0-134-148.us-west-1.compute.internal
00:26:28	openshift-dns		node-resolver-w7sds	Scheduled	Successfully assigned openshift-dns/node-resolver-w7sds to ip-10-0-134-148.us-west-1.compute.internal
01:14:23	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c to ip-10-0-129-234.us-west-1.compute.internal
00:26:29	openshift-network-diagnostics		network-check-target-8km4w	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-target-8km4w to ip-10-0-131-66.us-west-1.compute.internal
00:26:29	openshift-dns		node-resolver-fkt8d	Scheduled	Successfully assigned openshift-dns/node-resolver-fkt8d to ip-10-0-131-66.us-west-1.compute.internal
00:33:16	opendatahub-operator-system		opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Scheduled	Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6b5d59bb59-n8ht5 to ip-10-0-131-66.us-west-1.compute.internal
00:50:28	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs to ip-10-0-131-66.us-west-1.compute.internal
00:26:36	openshift-dns		node-resolver-9lcsd	Scheduled	Successfully assigned openshift-dns/node-resolver-9lcsd to ip-10-0-129-234.us-west-1.compute.internal
01:20:41	openshift-ingress		e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj to ip-10-0-129-234.us-west-1.compute.internal
01:53:30	openshift-ingress		e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n to ip-10-0-131-66.us-west-1.compute.internal
01:16:14	openshift-ingress		e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk to ip-10-0-129-234.us-west-1.compute.internal
00:27:06	openshift-ingress-canary		ingress-canary-qg288	Scheduled	Successfully assigned openshift-ingress-canary/ingress-canary-qg288 to ip-10-0-129-234.us-west-1.compute.internal
01:16:23	openshift-ingress		e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65 to ip-10-0-131-66.us-west-1.compute.internal
00:33:30	openshift-jobset-operator		jobset-operator-674cd59dc5-tn9c7	Scheduled	Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-tn9c7 to ip-10-0-134-148.us-west-1.compute.internal
01:13:53	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq to ip-10-0-131-66.us-west-1.compute.internal
00:26:36	openshift-network-operator		iptables-alerter-mgskf	Scheduled	Successfully assigned openshift-network-operator/iptables-alerter-mgskf to ip-10-0-129-234.us-west-1.compute.internal
02:34:11	openshift-jobset-operator		jobset-operator-674cd59dc5-82w5q	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
02:05:01	openshift-ingress		e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	Scheduled	Successfully assigned openshift-ingress/e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s to ip-10-0-129-234.us-west-1.compute.internal
00:26:59	openshift-dns		dns-default-b75ck	Scheduled	Successfully assigned openshift-dns/dns-default-b75ck to ip-10-0-131-66.us-west-1.compute.internal
00:34:16	openshift-jobset-operator		jobset-controller-manager-5dc75844c9-skm5b	Scheduled	Successfully assigned openshift-jobset-operator/jobset-controller-manager-5dc75844c9-skm5b to ip-10-0-129-234.us-west-1.compute.internal
02:17:38	openshift-ingress		e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	Scheduled	Successfully assigned openshift-ingress/e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp to ip-10-0-129-234.us-west-1.compute.internal
00:48:33	openshift-insights		periodic-gathering-fm2r2-k668x	Scheduled	Successfully assigned openshift-insights/periodic-gathering-fm2r2-k668x to ip-10-0-134-148.us-west-1.compute.internal
00:27:06	openshift-dns		dns-default-9v4jh	Scheduled	Successfully assigned openshift-dns/dns-default-9v4jh to ip-10-0-129-234.us-west-1.compute.internal
00:27:06	openshift-insights		periodic-gathering-894dj-29wl8	Scheduled	Successfully assigned openshift-insights/periodic-gathering-894dj-29wl8 to ip-10-0-131-66.us-west-1.compute.internal
00:41:22	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t to ip-10-0-129-234.us-west-1.compute.internal
00:44:39	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6 to ip-10-0-129-234.us-west-1.compute.internal
00:26:28	openshift-network-operator		iptables-alerter-h22zx	Scheduled	Successfully assigned openshift-network-operator/iptables-alerter-h22zx to ip-10-0-134-148.us-west-1.compute.internal
01:18:39	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5 to ip-10-0-129-234.us-west-1.compute.internal
00:26:58	openshift-dns		dns-default-6p5xt	Scheduled	Successfully assigned openshift-dns/dns-default-6p5xt to ip-10-0-134-148.us-west-1.compute.internal
00:40:37	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-mprgk to ip-10-0-134-148.us-west-1.compute.internal
01:14:54	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh to ip-10-0-129-234.us-west-1.compute.internal
00:53:13	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6 to ip-10-0-131-66.us-west-1.compute.internal
00:51:42	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf to ip-10-0-129-234.us-west-1.compute.internal
00:41:22	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx to ip-10-0-131-66.us-west-1.compute.internal
00:26:28	openshift-cluster-csi-drivers		aws-ebs-csi-driver-node-8h5z9	Scheduled	Successfully assigned openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h5z9 to ip-10-0-134-148.us-west-1.compute.internal
00:53:13	openshift-ingress		e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4 to ip-10-0-134-148.us-west-1.compute.internal
00:27:05	openshift-insights		insights-runtime-extractor-xhcgv	Scheduled	Successfully assigned openshift-insights/insights-runtime-extractor-xhcgv to ip-10-0-131-66.us-west-1.compute.internal
00:45:02	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-48xgr to ip-10-0-134-148.us-west-1.compute.internal
00:49:04	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj to ip-10-0-131-66.us-west-1.compute.internal
00:41:15	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-7blqg to ip-10-0-129-234.us-west-1.compute.internal
00:49:04	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x to ip-10-0-129-234.us-west-1.compute.internal
00:49:49	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc to ip-10-0-129-234.us-west-1.compute.internal
00:49:49	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz to ip-10-0-129-234.us-west-1.compute.internal
00:49:49	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv to ip-10-0-134-148.us-west-1.compute.internal
00:48:04	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c to ip-10-0-131-66.us-west-1.compute.internal
00:49:04	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7 to ip-10-0-134-148.us-west-1.compute.internal
01:13:30	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq to ip-10-0-131-66.us-west-1.compute.internal
02:34:14	openshift-console-operator		console-operator-7cd56b8dbc-nplbg	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:26:36	openshift-cluster-csi-drivers		aws-ebs-csi-driver-node-g96m5	Scheduled	Successfully assigned openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g96m5 to ip-10-0-129-234.us-west-1.compute.internal
00:26:28	openshift-network-diagnostics		network-check-target-9xnql	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-target-9xnql to ip-10-0-134-148.us-west-1.compute.internal
00:26:58	openshift-console-operator		console-operator-7cd56b8dbc-bwtwg	Scheduled	Successfully assigned openshift-console-operator/console-operator-7cd56b8dbc-bwtwg to ip-10-0-134-148.us-west-1.compute.internal
00:22:32	openshift-console-operator		console-operator-7cd56b8dbc-bwtwg	FailedScheduling	no nodes available to schedule pods
00:22:30	openshift-console-operator		console-operator-7cd56b8dbc-bwtwg	FailedScheduling	no nodes available to schedule pods
00:49:49	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g to ip-10-0-131-66.us-west-1.compute.internal
01:55:00	openshift-ingress		e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d to ip-10-0-131-66.us-west-1.compute.internal
00:27:30	openshift-console		downloads-6dd789c8b7-g6lwk	Scheduled	Successfully assigned openshift-console/downloads-6dd789c8b7-g6lwk to ip-10-0-129-234.us-west-1.compute.internal
00:27:05	openshift-insights		insights-runtime-extractor-jbbjm	Scheduled	Successfully assigned openshift-insights/insights-runtime-extractor-jbbjm to ip-10-0-134-148.us-west-1.compute.internal
00:27:06	openshift-insights		insights-runtime-extractor-9fbs4	Scheduled	Successfully assigned openshift-insights/insights-runtime-extractor-9fbs4 to ip-10-0-129-234.us-west-1.compute.internal
00:49:01	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n to ip-10-0-134-148.us-west-1.compute.internal
00:30:23	openshift-console		console-79f9c6b794-jzhvk	Scheduled	Successfully assigned openshift-console/console-79f9c6b794-jzhvk to ip-10-0-129-234.us-west-1.compute.internal
00:48:15	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb to ip-10-0-129-234.us-west-1.compute.internal
00:48:46	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c to ip-10-0-131-66.us-west-1.compute.internal
00:26:29	openshift-cluster-csi-drivers		aws-ebs-csi-driver-node-pjnxn	Scheduled	Successfully assigned openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjnxn to ip-10-0-131-66.us-west-1.compute.internal
00:49:01	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56 to ip-10-0-129-234.us-west-1.compute.internal
00:49:01	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs to ip-10-0-131-66.us-west-1.compute.internal
00:46:30	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx to ip-10-0-131-66.us-west-1.compute.internal
00:48:46	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq to ip-10-0-129-234.us-west-1.compute.internal
00:29:07	openshift-console		console-77cb9c864f-7k75w	Scheduled	Successfully assigned openshift-console/console-77cb9c864f-7k75w to ip-10-0-129-234.us-west-1.compute.internal
01:59:10	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln to ip-10-0-129-234.us-west-1.compute.internal
00:27:52	openshift-console		console-6dcc4446d8-gnncq	Scheduled	Successfully assigned openshift-console/console-6dcc4446d8-gnncq to ip-10-0-129-234.us-west-1.compute.internal
00:41:14	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8 to ip-10-0-134-148.us-west-1.compute.internal
00:48:15	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m to ip-10-0-134-148.us-west-1.compute.internal
00:45:00	openshift-ingress		e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2 to ip-10-0-129-234.us-west-1.compute.internal
00:26:58	openshift-insights		insights-operator-7c4986d449-8x7tk	Scheduled	Successfully assigned openshift-insights/insights-operator-7c4986d449-8x7tk to ip-10-0-134-148.us-west-1.compute.internal
00:27:30	openshift-console		console-64c74c7ff7-k7869	Scheduled	Successfully assigned openshift-console/console-64c74c7ff7-k7869 to ip-10-0-129-234.us-west-1.compute.internal
00:22:32	openshift-insights		insights-operator-7c4986d449-8x7tk	FailedScheduling	no nodes available to schedule pods
00:22:30	openshift-insights		insights-operator-7c4986d449-8x7tk	FailedScheduling	no nodes available to schedule pods
02:34:13	openshift-insights		insights-operator-7c4986d449-8h685	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:49:42	openshift-ingress		e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks to ip-10-0-134-148.us-west-1.compute.internal
00:27:43	openshift-console		console-59b5cfdfbd-f2rx8	Scheduled	Successfully assigned openshift-console/console-59b5cfdfbd-f2rx8 to ip-10-0-129-234.us-west-1.compute.internal
02:34:11	openshift-cluster-storage-operator		volume-data-source-validator-58c9f5f46d-r6ttl	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:26:58	openshift-cluster-storage-operator		volume-data-source-validator-58c9f5f46d-6hgmr	Scheduled	Successfully assigned openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-6hgmr to ip-10-0-134-148.us-west-1.compute.internal
00:22:32	openshift-cluster-storage-operator		volume-data-source-validator-58c9f5f46d-6hgmr	FailedScheduling	no nodes available to schedule pods
00:22:30	openshift-cluster-storage-operator		volume-data-source-validator-58c9f5f46d-6hgmr	FailedScheduling	no nodes available to schedule pods
00:26:59	openshift-cluster-storage-operator		volume-data-source-validator-57b896c65c-zttnm	FailedScheduling	0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 node(s) didn't match Pod's node affinity/selector. no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.
00:26:58	openshift-cluster-storage-operator		volume-data-source-validator-57b896c65c-zttnm	FailedScheduling	0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.
00:22:32	openshift-cluster-storage-operator		volume-data-source-validator-57b896c65c-zttnm	FailedScheduling	no nodes available to schedule pods
00:22:30	openshift-cluster-storage-operator		volume-data-source-validator-57b896c65c-zttnm	FailedScheduling	no nodes available to schedule pods
00:26:36	openshift-network-diagnostics		network-check-target-nj7c4	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-target-nj7c4 to ip-10-0-129-234.us-west-1.compute.internal
00:26:58	openshift-cluster-samples-operator		cluster-samples-operator-6ddb6c8b94-nq7ch	Scheduled	Successfully assigned openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nq7ch to ip-10-0-134-148.us-west-1.compute.internal
00:22:32	openshift-cluster-samples-operator		cluster-samples-operator-6ddb6c8b94-nq7ch	FailedScheduling	no nodes available to schedule pods
00:22:30	openshift-cluster-samples-operator		cluster-samples-operator-6ddb6c8b94-nq7ch	FailedScheduling	no nodes available to schedule pods
02:34:13	openshift-cluster-samples-operator		cluster-samples-operator-6ddb6c8b94-mbqzr	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
00:26:36	openshift-cluster-node-tuning-operator		tuned-mdc9b	Scheduled	Successfully assigned openshift-cluster-node-tuning-operator/tuned-mdc9b to ip-10-0-129-234.us-west-1.compute.internal
00:26:29	openshift-cluster-node-tuning-operator		tuned-d6cwn	Scheduled	Successfully assigned openshift-cluster-node-tuning-operator/tuned-d6cwn to ip-10-0-131-66.us-west-1.compute.internal
00:21:18	openshift-cluster-version	openshift-cluster-version	version	LeaderElection	cluster-version-operator-7dbd5d4848-gw7ws_a7d766f4-85d2-4834-8282-3ba8fe353e3a became leader
00:21:20	openshift-cluster-version	openshift-cluster-version	version	LoadPayload	Loading payload version="4.22.20" image="registry.build08.ci.openshift.org/ci-op-w44mt3vk/release@sha256:b94e4b85832b43dfa35785551effe5d16e122e3fa3ed277b6d765c945fe5ef14"
00:21:20	openshift-cluster-version	openshift-cluster-version	version	RetrievePayload	Retrieving and verifying payload version="4.22.20" image="registry.build08.ci.openshift.org/ci-op-w44mt3vk/release@sha256:b94e4b85832b43dfa35785551effe5d16e122e3fa3ed277b6d765c945fe5ef14"
00:21:21	openshift-cluster-version	openshift-cluster-version	version	PayloadLoaded	Payload loaded version="4.22.20" image="registry.build08.ci.openshift.org/ci-op-w44mt3vk/release@sha256:b94e4b85832b43dfa35785551effe5d16e122e3fa3ed277b6d765c945fe5ef14" architecture="Multi"
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Degraded message changed from "DeploymentVersionControllerDegraded: could not get Deployment csi-snapshot-controller in Namespace clusters-5ce226450bd4aaa499fe: deployment.apps \"csi-snapshot-controller\" not found" to "All is well"
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotgueststaticresourcecontroller-csisnapshotgueststaticresourcecontroller-staticresources	csi-snapshot-controller-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io because it was missing
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Progressing changed from Unknown to True ("CSISnapshotControllerProgressing: Waiting for Deployment to act on changes"),Available changed from Unknown to False ("CSISnapshotControllerAvailable: Waiting for Deployment")
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotgueststaticresourcecontroller-csisnapshotgueststaticresourcecontroller-staticresources	csi-snapshot-controller-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io because it was missing
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Degraded message changed from "WebhookRemovalControllerDegraded: csisnapshotcontrollers.operator.openshift.io \"cluster\" not found" to "DeploymentVersionControllerDegraded: could not get Deployment csi-snapshot-controller in Namespace clusters-5ce226450bd4aaa499fe: deployment.apps \"csi-snapshot-controller\" not found"
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotcontroller-deployment-controller--csisnapshotcontroller	csi-snapshot-controller-operator	DeploymentCreated	Created Deployment.apps/csi-snapshot-controller -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotgueststaticresourcecontroller-csisnapshotgueststaticresourcecontroller-staticresources	csi-snapshot-controller-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io because it was missing
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Degraded set to False ("WebhookRemovalControllerDegraded: csisnapshotcontrollers.operator.openshift.io \"cluster\" not found"),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown ("")
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotstaticresourcecontroller-csisnapshotstaticresourcecontroller-staticresources	csi-snapshot-controller-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/csi-snapshot-controller-pdb -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotstaticresourcecontroller-csisnapshotstaticresourcecontroller-staticresources	csi-snapshot-controller-operator	ServiceAccountCreated	Created ServiceAccount/csi-snapshot-controller -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:28	openshift-cluster-storage-operator	csi-snapshot-controller	csi-snapshot-controller-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:21:28	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumepopulators.populator.storage.k8s.io because it was missing
00:21:28	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "All is well" to "DefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found"
00:21:28	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/volume-data-source-validator because it was missing
00:21:28	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded changed from Unknown to False ("All is well")
00:21:28	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/volume-data-source-validator because it was missing
00:21:28	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Progressing changed from Unknown to True ("DefaultStorageClassControllerProgressing: infrastructure.config.openshift.io \"cluster\" not found"),Available changed from Unknown to False ("DefaultStorageClassControllerAvailable: infrastructure.config.openshift.io \"cluster\" not found")
00:21:28	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	ServiceAccountCreated	Created ServiceAccount/volume-data-source-validator -n openshift-cluster-storage-operator because it was missing
00:21:28	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded set to Unknown (""),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown (""),status.relatedObjects changed from [] to [{"" "namespaces" "" "openshift-cluster-storage-operator"} {"" "namespaces" "" "openshift-cluster-csi-drivers"} {"operator.openshift.io" "storages" "" "cluster"} {"rbac.authorization.k8s.io" "clusterrolebindings" "" "cluster-storage-operator-role"}],status.versions changed from [] to [{"operator" "4.22.20"}]
00:21:28	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorVersionChanged	clusteroperator/storage version "operator" changed from "" to "4.22.20"
00:21:28	openshift-cluster-storage-operator	storage	aws-cloud-controller-manager	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:21:29	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "DefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found\nCSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found" to "DefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found\nCSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found"
00:21:29	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "DefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found" to "DefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found\nCSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found"
00:21:29	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Progressing message changed from "CSISnapshotControllerProgressing: Waiting for Deployment to act on changes" to "CSISnapshotControllerProgressing: Waiting for Deployment to deploy pods"
00:21:29	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Upgradeable changed from Unknown to True ("All is well")
00:21:33	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: status.versions changed from [] to [{"operator" "4.22.20"} {"csi-snapshot-controller" "4.22.20"}]
00:21:33	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotcontroller-deployment-controller--csisnapshotcontroller	csi-snapshot-controller-operator	DeploymentUpdated	Updated Deployment.apps/csi-snapshot-controller -n clusters-5ce226450bd4aaa499fe because it changed
00:21:33 (x3)	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorVersionChanged	clusteroperator/csi-snapshot-controller version "csi-snapshot-controller" changed from "" to "4.22.20"
00:21:33 (x3)	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorVersionChanged	clusteroperator/csi-snapshot-controller version "operator" changed from "" to "4.22.20"
00:21:33	openshift-cluster-storage-operator	snapshot-controller-leader/csi-snapshot-controller-84bb89d976-g5x2j	snapshot-controller-leader	LeaderElection	csi-snapshot-controller-84bb89d976-g5x2j became leader
00:21:33	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Progressing changed from True to False ("CSISnapshotControllerProgressing: Deployment is not progressing"),Available changed from False to True ("CSISnapshotControllerAvailable: Deployment is available")
00:21:38	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Progressing changed from True to False ("All is well"),Available changed from False to True ("DefaultStorageClassControllerAvailable: No default StorageClass for this platform")
00:21:38	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Upgradeable changed from Unknown to True ("All is well")
00:21:38	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "DefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found\nCSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found" to "DefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found"
00:21:38 (x12)	openshift-cluster-storage-operator	storage-config-observer-controller--config-observer-configobserver	aws-cloud-controller-manager	ObserveProxyConfig	proxy.config.openshift.io/cluster not found
00:21:44	openshift-image-registry	image-registry-operator	openshift-master-controllers	LeaderElection	cluster-image-registry-operator-697798658-4jw8g_34e0f8db-da71-4f46-a907-c41532fe4e07 became leader
00:21:45	openshift-image-registry	image-registry-operator	openshift-image-registry	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-AWSEBS	aws-cloud-controller-manager	ClusterCSIDriverCreated	Created ClusterCSIDriver.operator.openshift.io/ebs.csi.aws.com -n openshift-cluster-csi-drivers because it was missing
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-role -n openshift-cluster-csi-drivers because it was missing
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-AWSEBS	aws-cloud-controller-manager	DeploymentCreated	Created Deployment.apps/aws-ebs-csi-driver-operator -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatormgmtstaticcontroller-awsebscsidriveroperatormgmtstaticcontroller-staticresources	aws-cloud-controller-manager	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-role -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatormgmtstaticcontroller-awsebscsidriveroperatormgmtstaticcontroller-staticresources	aws-cloud-controller-manager	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-operator -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:46	openshift-image-registry	image-registry-operator	openshift-image-registry	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/image-pruner-networkpolicy -n openshift-image-registry because it was missing
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatormgmtstaticcontroller-awsebscsidriveroperatormgmtstaticcontroller-staticresources	aws-cloud-controller-manager	ServiceCreated	Created Service/aws-ebs-csi-driver-operator-metrics -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatormgmtstaticcontroller-awsebscsidriveroperatormgmtstaticcontroller-staticresources	aws-cloud-controller-manager	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-rolebinding -n clusters-5ce226450bd4aaa499fe because it was missing
00:21:46	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-operator -n openshift-cluster-csi-drivers because it was missing
00:21:47	openshift-image-registry	image-registry-operator-config-observer-configobserver	openshift-image-registry	ObservedConfigChanged	Writing updated observed config: @@ -1 +1,16 @@ -{} +{ + "servingInfo": { + "cipherSuites": [ + "TLS_AES_128_GCM_SHA256", + "TLS_AES_256_GCM_SHA384", + "TLS_CHACHA20_POLY1305_SHA256", + "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", + "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", + "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", + "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", + "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256", + "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256" + ], + "minTLSVersion": "VersionTLS12" + } +}
00:21:47	openshift-image-registry	image-registry-operator-config-observer-configobserver	openshift-image-registry	ObserveTLSSecurityProfile	cipherSuites changed to ["TLS_AES_128_GCM_SHA256" "TLS_AES_256_GCM_SHA384" "TLS_CHACHA20_POLY1305_SHA256" "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256" "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256" "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384" "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384" "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256" "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256"]
00:21:47	openshift-image-registry	image-registry-operator-config-observer-configobserver	openshift-image-registry	ObserveTLSSecurityProfile	minTLSVersion changed to VersionTLS12
00:21:47	openshift-monitoring	deployment-controller	cluster-monitoring-operator	ScalingReplicaSet	Scaled up replica set cluster-monitoring-operator-884576c57 from 0 to 1
00:21:47	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-rolebinding -n openshift-cluster-csi-drivers because it was missing
00:21:47	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-clusterrole because it was missing
00:21:48	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-clusterrolebinding because it was missing
00:21:48	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatordeploymentcontroller-deployment-controller--volumedatasourcevalidatordeploymentcontroller	aws-cloud-controller-manager	DeploymentCreated	Created Deployment.apps/volume-data-source-validator -n openshift-cluster-storage-operator because it was missing
00:21:50	openshift-cloud-credential-operator	cloud-credential-operator	cloud-credential-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:21:50	openshift-insights	deployment-controller	insights-operator	ScalingReplicaSet	Scaled up replica set insights-operator-7c4986d449 from 0 to 1
00:21:54	openshift-image-registry	image-registry-operator	openshift-image-registry	DaemonSetCreated	Created DaemonSet.apps/node-ca -n openshift-image-registry because it was missing
00:21:58	openshift-kube-storage-version-migrator-operator	deployment-controller	kube-storage-version-migrator-operator	ReplicaSetCreateError	Failed to create new replica set "kube-storage-version-migrator-operator-7d4bc45dd6": Internal error occurred: admission plugin "PodSecurity" failed to complete validation in 13s
00:21:59	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatordeploymentcontroller-deployment-controller--volumedatasourcevalidatordeploymentcontroller	aws-cloud-controller-manager	DeploymentUpdated	Updated Deployment.apps/volume-data-source-validator -n openshift-cluster-storage-operator because it changed
00:21:59	openshift-ingress-operator	cluster-ingress-operator	ingress-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:21:59	openshift-monitoring	replicaset-controller	cluster-monitoring-operator-884576c57	FailedCreate	Error creating: pods "cluster-monitoring-operator-884576c57-" is forbidden: error fetching namespace "openshift-monitoring": unable to find annotation openshift.io/sa.scc.uid-range
00:21:59	openshift-service-ca-operator	deployment-controller	service-ca-operator	ReplicaSetCreateError	Failed to create new replica set "service-ca-operator-544d749c8c": Internal error occurred: admission plugin "PodSecurity" failed to complete validation in 13s
00:22:00	openshift-insights	replicaset-controller	insights-operator-7c4986d449	FailedCreate	Error creating: pods "insights-operator-7c4986d449-" is forbidden: error fetching namespace "openshift-insights": unable to find annotation openshift.io/sa.scc.uid-range
00:22:00	openshift-cluster-storage-operator	storage-CSIDriverStarter-AWSEBS	aws-cloud-controller-manager	DeploymentUpdated	Updated Deployment.apps/aws-ebs-csi-driver-operator -n clusters-5ce226450bd4aaa499fe because it changed
00:22:00	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator	aws-ebs-csi-driver-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:22:00	openshift-cluster-storage-operator	deployment-controller	volume-data-source-validator	ScalingReplicaSet	Scaled up replica set volume-data-source-validator-57b896c65c from 0 to 1
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-volumeattributesclass-reader-resizer-binding because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator	aws-ebs-csi-driver-operator	StorageClassCreated	Created StorageClass.storage.k8s.io/gp3-csi because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-config-observer-controller-awsebsdrivercsiconfigobservercontroller-config-observer-configobserver	aws-ebs-csi-driver-operator	ObservedConfigChanged	Writing updated observed config: @@ -1 +1,18 @@ -{} +{ + "targetcsiconfig": { + "servingInfo": { + "cipherSuites": [ + "TLS_AES_128_GCM_SHA256", + "TLS_AES_256_GCM_SHA384", + "TLS_CHACHA20_POLY1305_SHA256", + "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", + "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", + "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", + "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", + "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256", + "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256" + ], + "minTLSVersion": "VersionTLS12" + } + } +}
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-driver-node-service_awsebsdrivernodeservicecontroller-awsebsdrivernodeservicecontroller	aws-ebs-csi-driver-operator	DaemonSetUpdated	Updated DaemonSet.apps/aws-ebs-csi-driver-node -n openshift-cluster-csi-drivers because it changed
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-config-observer-controller-awsebsdrivercsiconfigobservercontroller-config-observer-configobserver	aws-ebs-csi-driver-operator	ObserveTLSSecurityProfile	cipherSuites changed to ["TLS_AES_128_GCM_SHA256" "TLS_AES_256_GCM_SHA384" "TLS_CHACHA20_POLY1305_SHA256" "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256" "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256" "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384" "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384" "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256" "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256"]
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-config-observer-controller-awsebsdrivercsiconfigobservercontroller-config-observer-configobserver	aws-ebs-csi-driver-operator	ObserveTLSSecurityProfile	minTLSVersion changed to VersionTLS12
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/ebs-kube-rbac-proxy-role because it was missing
00:22:01	openshift-config-managed	certificate_publisher_controller	default-ingress-cert	PublishedRouterCA	Published "default-ingress-cert" in "openshift-config-managed"
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/aws-ebs-csi-driver-controller-pdb -n clusters-5ce226450bd4aaa499fe because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-lease-leader-election -n openshift-cluster-csi-drivers because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator	aws-ebs-csi-driver-operator	StorageClassCreated	Created StorageClass.storage.k8s.io/gp2-csi because it was missing
00:22:01	openshift-config-managed	certificate_publisher_controller	router-certs	PublishedRouterCertificates	Published router certificates
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-driver-node-service_awsebsdrivernodeservicecontroller-awsebsdrivernodeservicecontroller	aws-ebs-csi-driver-operator	DaemonSetCreated	Created DaemonSet.apps/aws-ebs-csi-driver-node -n openshift-cluster-csi-drivers because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-controller-sa -n clusters-5ce226450bd4aaa499fe because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/ebs-privileged-role because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-prometheus -n openshift-cluster-csi-drivers because it was missing
00:22:01	openshift-ingress-operator	certificate_controller	router-ca	CreatedWildcardCACert	Created a default wildcard CA certificate
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ServiceCreated	Created Service/aws-ebs-csi-driver-controller-metrics -n clusters-5ce226450bd4aaa499fe because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrollerservicecontroller-deployment-controller--awsebsdrivercontrollerservicecontroller	aws-ebs-csi-driver-operator	DeploymentCreated	Created Deployment.apps/aws-ebs-csi-driver-controller -n clusters-5ce226450bd4aaa499fe because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ConfigMapCreated	Created ConfigMap/aws-ebs-csi-driver-trusted-ca-bundle -n clusters-5ce226450bd4aaa499fe because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-provisioner-binding because it was missing
00:22:01	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-prometheus -n openshift-cluster-csi-drivers because it was missing
00:22:01	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-b48ff49b9 from 0 to 1
00:22:01	openshift-ingress-operator	ingress_controller	default	Admitted	ingresscontroller passed validation
00:22:02	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-lease-leader-election -n openshift-cluster-csi-drivers because it was missing
00:22:02	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-kube-rbac-proxy-binding because it was missing
00:22:03	openshift-network-operator	network-operator	network-operator-lock	LeaderElection	cluster-network-operator-64d67b4648-7f4qk_7cf53836-89c3-4ed1-9944-95ef678e3d2f became leader
00:22:03	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-volumesnapshot-reader-provisioner-binding because it was missing
00:22:03	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-node-privileged-binding because it was missing
00:22:03	openshift-network-operator	network-operator	openshift-network-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:22:03	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-resizer-binding because it was missing
00:22:04	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-snapshotter-binding because it was missing
00:22:04	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-attacher-binding because it was missing
00:22:05	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-node-sa -n openshift-cluster-csi-drivers because it was missing
00:22:05	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-storageclass-reader-resizer-binding because it was missing
00:22:05	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	(combined from similar events): Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-volumeattributesclass-reader-provisioner-binding because it was missing
00:22:05	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	CSIDriverCreated	Created CSIDriver.storage.k8s.io/ebs.csi.aws.com because it was missing
00:22:11	openshift-cluster-csi-drivers	ebs.csi.aws.com/aws-ebs-csi-driver-controller-57d499b89f-drs86	ebs-csi-aws-com	LeaderElection	aws-ebs-csi-driver-controller-57d499b89f-drs86 became leader
00:22:11	openshift-ingress-canary	canary_certificate_controller	canary-serving-cert	CreatedCanaryCertificate	created canary certificate
00:22:13	openshift-cluster-csi-drivers	external-attacher-leader-ebs.csi.aws.com/aws-ebs-csi-driver-controller-57d499b89f-drs86	external-attacher-leader-ebs-csi-aws-com	LeaderElection	aws-ebs-csi-driver-controller-57d499b89f-drs86 became leader
00:22:14	openshift-controller-manager	openshift-controller-manager	openshift-master-controllers	LeaderElection	openshift-controller-manager-bdf47df49-k8gdp_824737ce-99ef-42d3-a550-1f3035c361a9 became leader
00:22:14	openshift-cluster-csi-drivers	external-resizer-ebs-csi-aws-com/aws-ebs-csi-driver-controller-57d499b89f-drs86	external-resizer-ebs-csi-aws-com	LeaderElection	aws-ebs-csi-driver-controller-57d499b89f-drs86 became leader
00:22:15	openshift-cluster-csi-drivers	external-snapshotter-leader-ebs.csi.aws.com/aws-ebs-csi-driver-controller-57d499b89f-drs86	external-snapshotter-leader-ebs-csi-aws-com	LeaderElection	aws-ebs-csi-driver-controller-57d499b89f-drs86 became leader
00:22:15	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
00:22:15	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
00:22:16	openshift-kube-controller-manager	cluster-policy-controller	cluster-policy-controller-lock	LeaderElection	cluster-policy-controller-56b689dc9c-vf2kk_3dac6471-5fe6-49dc-b3f2-9ff6ba3752c1 became leader
00:22:17 (x4)	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrollerservicecontroller-deployment-controller--awsebsdrivercontrollerservicecontroller	aws-ebs-csi-driver-operator	DeploymentUpdated	Updated Deployment.apps/aws-ebs-csi-driver-controller -n clusters-5ce226450bd4aaa499fe because it changed
00:22:18	openshift-cluster-node-tuning-operator	cluster-node-tuning-operator-6cf69b69b8-cvkjd_d7f568f0-3486-4d08-9bd2-02d2cd052f0c	node-tuning-operator-lock	LeaderElection	cluster-node-tuning-operator-6cf69b69b8-cvkjd_d7f568f0-3486-4d08-9bd2-02d2cd052f0c became leader
00:22:19	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-machine-approver namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-route-controller-manager namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kube-public namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-dns namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-service-ca-operator namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-controller-manager namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-samples-operator namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-apiserver-operator namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift namespace
00:22:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-scheduler-operator namespace
00:22:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-console namespace
00:22:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-image-registry namespace
00:22:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-scheduler namespace
00:22:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ingress-canary namespace
00:22:21	openshift-ingress-canary	canary_controller	ingress-canary	CanaryCertRotated	Canary serving cert rotated, updated pod template annotation hash: 0898f964
00:22:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-etcd namespace
00:22:22	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-machine-config-operator namespace
00:22:22	openshift-image-registry	image-registry-operator	openshift-image-registry	DeploymentCreated	Created Deployment.apps/image-registry -n openshift-image-registry because it was missing
00:22:22	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kube-system namespace
00:22:22	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-authentication namespace
00:22:22	openshift-image-registry	image-registry-operator	openshift-image-registry	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/image-registry-networkpolicy -n openshift-image-registry because it was missing
00:22:22	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cloud-credential-operator namespace
00:22:22	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-operator namespace
00:22:23	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-csi-drivers namespace
00:22:23	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-node namespace
00:22:23	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-dns-operator namespace
00:22:23	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cloud-network-config-controller namespace
00:22:23	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-controller-manager namespace
00:22:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-config namespace
00:22:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-storage-version-migrator-operator namespace
00:22:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-console-user-settings namespace
00:22:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cloud-controller-manager namespace
00:22:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-storage-operator namespace
00:22:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ovn-kubernetes namespace
00:22:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-machine-api namespace
00:22:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-multus namespace
00:22:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-user-workload-monitoring namespace
00:22:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-monitoring namespace
00:22:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-operator-lifecycle-manager namespace
00:22:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-apiserver namespace
00:22:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-authentication-operator namespace
00:22:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-node-tuning-operator namespace
00:22:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-config-operator namespace
00:22:27	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-controller-manager-operator namespace
00:22:27	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for default namespace
00:22:27	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-operators namespace
00:22:27	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ingress namespace
00:22:27	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-apiserver namespace
00:22:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ingress-operator namespace
00:22:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-config-managed namespace
00:22:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-apiserver-operator namespace
00:22:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-version namespace
00:22:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-controller-manager-operator namespace
00:22:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-marketplace namespace
00:22:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kube-node-lease namespace
00:22:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-infra namespace
00:22:29	openshift-ovn-kubernetes	ovnk-controlplane	ovn-kubernetes-master	LeaderElection	ovnkube-control-plane-6f64cfdccc-w629g became leader
00:22:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-insights namespace
00:22:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-console-operator namespace
00:22:30	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-node-identity namespace
00:22:30	openshift-image-registry	replicaset-controller	image-registry-dfd9f5756	SuccessfulCreate	Created pod: image-registry-dfd9f5756-s9tvc
00:22:30	openshift-cluster-samples-operator	deployment-controller	cluster-samples-operator	ScalingReplicaSet	Scaled up replica set cluster-samples-operator-6ddb6c8b94 from 0 to 1
00:22:30	openshift-console-operator	replicaset-controller	console-operator-7cd56b8dbc	SuccessfulCreate	Created pod: console-operator-7cd56b8dbc-bwtwg
00:22:30	openshift-console-operator	deployment-controller	console-operator	ScalingReplicaSet	Scaled up replica set console-operator-7cd56b8dbc from 0 to 1
00:22:30	openshift-service-ca-operator	replicaset-controller	service-ca-operator-544d749c8c	SuccessfulCreate	Created pod: service-ca-operator-544d749c8c-bkjl8
00:22:30	openshift-service-ca-operator	deployment-controller	service-ca-operator	ScalingReplicaSet	Scaled up replica set service-ca-operator-544d749c8c from 0 to 1
00:22:30	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled up replica set image-registry-dfd9f5756 from 0 to 1
00:22:30 (x2)	openshift-image-registry	controllermanager	image-registry	NoPods	No matching pods found
00:22:30	openshift-cluster-samples-operator	replicaset-controller	cluster-samples-operator-6ddb6c8b94	SuccessfulCreate	Created pod: cluster-samples-operator-6ddb6c8b94-nq7ch
00:22:30	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-host-network namespace
00:22:30	openshift-network-diagnostics	deployment-controller	network-check-source	ScalingReplicaSet	Scaled up replica set network-check-source-6f78d59f99 from 0 to 1
00:22:30	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-57b896c65c	SuccessfulCreate	Created pod: volume-data-source-validator-57b896c65c-zttnm
00:22:30	openshift-monitoring	replicaset-controller	cluster-monitoring-operator-884576c57	SuccessfulCreate	Created pod: cluster-monitoring-operator-884576c57-nqmlz
00:22:30	openshift-ingress	replicaset-controller	router-default-b48ff49b9	SuccessfulCreate	Created pod: router-default-b48ff49b9-v8tjs
00:22:30	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-58c9f5f46d	SuccessfulCreate	Created pod: volume-data-source-validator-58c9f5f46d-6hgmr
00:22:30	openshift-kube-storage-version-migrator-operator	replicaset-controller	kube-storage-version-migrator-operator-7d4bc45dd6	SuccessfulCreate	Created pod: kube-storage-version-migrator-operator-7d4bc45dd6-h2t24
00:22:30	openshift-insights	replicaset-controller	insights-operator-7c4986d449	SuccessfulCreate	Created pod: insights-operator-7c4986d449-8x7tk
00:22:30	openshift-network-diagnostics	replicaset-controller	network-check-source-6f78d59f99	SuccessfulCreate	Created pod: network-check-source-6f78d59f99-knrbl
00:22:30	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-diagnostics namespace
00:22:30	openshift-cluster-storage-operator	deployment-controller	volume-data-source-validator	ScalingReplicaSet	Scaled up replica set volume-data-source-validator-58c9f5f46d from 0 to 1
00:22:30	openshift-kube-storage-version-migrator-operator	deployment-controller	kube-storage-version-migrator-operator	ScalingReplicaSet	Scaled up replica set kube-storage-version-migrator-operator-7d4bc45dd6 from 0 to 1
00:22:34	openshift-network-console	replicaset-controller	networking-console-plugin-86c478bb88	SuccessfulCreate	Created pod: networking-console-plugin-86c478bb88-v4tzv
00:22:34	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-console namespace
00:22:34	openshift-network-console	deployment-controller	networking-console-plugin	ScalingReplicaSet	Scaled up replica set networking-console-plugin-86c478bb88 from 0 to 1
00:22:38	openshift-network-node-identity	network-node-identity-dbdccd74d-bf5tj_39f6f4f6-d8dc-4a4c-a1cf-e77ccf89a512	ovnkube-identity	LeaderElection	network-node-identity-dbdccd74d-bf5tj_39f6f4f6-d8dc-4a4c-a1cf-e77ccf89a512 became leader
00:26:28	openshift-network-operator	kubelet	iptables-alerter-h22zx	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472"
00:26:28	openshift-multus	daemonset-controller	network-metrics-daemon	SuccessfulCreate	Created pod: network-metrics-daemon-gqvhh
00:26:28	openshift-image-registry	kubelet	node-ca-qdq6c	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c"
00:26:28	openshift-image-registry	daemonset-controller	node-ca	SuccessfulCreate	Created pod: node-ca-qdq6c
00:26:28	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65a324fc19ef3da53cecb9dc13e0c07696c595996d3c07d1a5dfd427f6a61e6e"
00:26:28	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a"
00:26:28	openshift-cluster-node-tuning-operator	daemonset-controller	tuned	SuccessfulCreate	Created pod: tuned-9mfzm
00:26:28	openshift-dns	daemonset-controller	node-resolver	SuccessfulCreate	Created pod: node-resolver-w7sds
00:26:28	openshift-ovn-kubernetes	daemonset-controller	ovnkube-node	SuccessfulCreate	Created pod: ovnkube-node-wlldw
00:26:28	openshift-multus	daemonset-controller	multus	SuccessfulCreate	Created pod: multus-mw7mj
00:26:28	openshift-multus	daemonset-controller	multus-additional-cni-plugins	SuccessfulCreate	Created pod: multus-additional-cni-plugins-wcpdn
00:26:28	openshift-network-operator	daemonset-controller	iptables-alerter	SuccessfulCreate	Created pod: iptables-alerter-h22zx
00:26:28	openshift-network-diagnostics	daemonset-controller	network-check-target	SuccessfulCreate	Created pod: network-check-target-9xnql
00:26:28	openshift-cluster-node-tuning-operator	kubelet	tuned-9mfzm	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c"
00:26:28	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:007ba215236827a40e1b33f3799d289065305ae886c05e51214d74d0ff24d62d"
00:26:28	openshift-cluster-csi-drivers	daemonset-controller	aws-ebs-csi-driver-node	SuccessfulCreate	Created pod: aws-ebs-csi-driver-node-8h5z9
00:26:29	openshift-multus	daemonset-controller	multus-additional-cni-plugins	SuccessfulCreate	Created pod: multus-additional-cni-plugins-mf6df
00:26:29	openshift-network-operator	daemonset-controller	iptables-alerter	SuccessfulCreate	Created pod: iptables-alerter-zpf48
00:26:29	openshift-ovn-kubernetes	daemonset-controller	ovnkube-node	SuccessfulCreate	Created pod: ovnkube-node-qmx5k
00:26:29	openshift-dns	daemonset-controller	node-resolver	SuccessfulCreate	Created pod: node-resolver-fkt8d
00:26:29	openshift-dns	kubelet	node-resolver-w7sds	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472"
00:26:29	openshift-multus	daemonset-controller	multus	SuccessfulCreate	Created pod: multus-cxrhl
00:26:29	openshift-image-registry	daemonset-controller	node-ca	SuccessfulCreate	Created pod: node-ca-2jtx2
00:26:29	openshift-cluster-node-tuning-operator	daemonset-controller	tuned	SuccessfulCreate	Created pod: tuned-d6cwn
00:26:29	openshift-network-diagnostics	daemonset-controller	network-check-target	SuccessfulCreate	Created pod: network-check-target-8km4w
00:26:29	openshift-multus	kubelet	multus-mw7mj	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0"
00:26:29	openshift-cluster-csi-drivers	daemonset-controller	aws-ebs-csi-driver-node	SuccessfulCreate	Created pod: aws-ebs-csi-driver-node-pjnxn
00:26:29	openshift-multus	daemonset-controller	network-metrics-daemon	SuccessfulCreate	Created pod: network-metrics-daemon-2vxt5
00:26:31	openshift-network-operator	kubelet	iptables-alerter-zpf48	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472"
00:26:31	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65a324fc19ef3da53cecb9dc13e0c07696c595996d3c07d1a5dfd427f6a61e6e"
00:26:31	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:007ba215236827a40e1b33f3799d289065305ae886c05e51214d74d0ff24d62d"
00:26:31	openshift-dns	kubelet	node-resolver-fkt8d	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472"
00:26:31	openshift-multus	kubelet	multus-cxrhl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0"
00:26:31	openshift-cluster-node-tuning-operator	kubelet	tuned-d6cwn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c"
00:26:31	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a"
00:26:31	openshift-image-registry	kubelet	node-ca-2jtx2	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c"
00:26:32	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65a324fc19ef3da53cecb9dc13e0c07696c595996d3c07d1a5dfd427f6a61e6e" in 3.729s (3.729s including waiting). Image size: 243835914 bytes.
00:26:33	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Created	Container created
00:26:33	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Started	Container started
00:26:34	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65a324fc19ef3da53cecb9dc13e0c07696c595996d3c07d1a5dfd427f6a61e6e" in 2.994s (2.994s including waiting). Image size: 243835914 bytes.
00:26:34	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Created	Container created
00:26:34	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe6e5decc2a69ebef017fc4610e9fbfcd0425d14176b528829f3c5091556205b"
00:26:34	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Started	Container started
00:26:35	openshift-image-registry	kubelet	node-ca-qdq6c	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c" in 6.315s (6.315s including waiting). Image size: 314097073 bytes.
00:26:35	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe6e5decc2a69ebef017fc4610e9fbfcd0425d14176b528829f3c5091556205b"
00:26:35	openshift-image-registry	kubelet	node-ca-qdq6c	Created	Container created
00:26:35	openshift-image-registry	kubelet	node-ca-qdq6c	Started	Container started
00:26:36	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:007ba215236827a40e1b33f3799d289065305ae886c05e51214d74d0ff24d62d" in 7.142s (7.142s including waiting). Image size: 341105288 bytes.
00:26:36	openshift-multus	daemonset-controller	multus-additional-cni-plugins	SuccessfulCreate	Created pod: multus-additional-cni-plugins-2ckv6
00:26:36	openshift-image-registry	daemonset-controller	node-ca	SuccessfulCreate	Created pod: node-ca-2l6ct
00:26:36	openshift-image-registry	kubelet	node-ca-2jtx2	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c" in 5.398s (5.398s including waiting). Image size: 314097073 bytes.
00:26:36	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Created	Container created
00:26:36	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Started	Container started
00:26:36	openshift-image-registry	replicaset-controller	image-registry-6c9bd86665	SuccessfulCreate	Created pod: image-registry-6c9bd86665-k87ds
00:26:36	openshift-network-diagnostics	daemonset-controller	network-check-target	SuccessfulCreate	Created pod: network-check-target-nj7c4
00:26:36	openshift-multus	daemonset-controller	multus	SuccessfulCreate	Created pod: multus-4rhrt
00:26:36	openshift-multus	daemonset-controller	network-metrics-daemon	SuccessfulCreate	Created pod: network-metrics-daemon-jw8gx
00:26:36	openshift-network-operator	daemonset-controller	iptables-alerter	SuccessfulCreate	Created pod: iptables-alerter-mgskf
00:26:36	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled up replica set image-registry-6c9bd86665 from 0 to 1
00:26:36	openshift-cluster-csi-drivers	daemonset-controller	aws-ebs-csi-driver-node	SuccessfulCreate	Created pod: aws-ebs-csi-driver-node-g96m5
00:26:36	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a5e96bc702bc529b424e6c80f95d7d4fc4fe92f83df4a77c3b47eb3a30fe729"
00:26:36	openshift-ovn-kubernetes	daemonset-controller	ovnkube-node	SuccessfulCreate	Created pod: ovnkube-node-gzk2m
00:26:36	openshift-cluster-node-tuning-operator	daemonset-controller	tuned	SuccessfulCreate	Created pod: tuned-mdc9b
00:26:36	openshift-dns	daemonset-controller	node-resolver	SuccessfulCreate	Created pod: node-resolver-9lcsd
00:26:37	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65a324fc19ef3da53cecb9dc13e0c07696c595996d3c07d1a5dfd427f6a61e6e"
00:26:37	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Created	Container created
00:26:37	openshift-network-operator	kubelet	iptables-alerter-mgskf	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472"
00:26:37	openshift-dns	kubelet	node-resolver-9lcsd	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472"
00:26:37	openshift-multus	kubelet	multus-4rhrt	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0"
00:26:37	openshift-image-registry	kubelet	node-ca-2jtx2	Started	Container started
00:26:37	openshift-image-registry	kubelet	node-ca-2l6ct	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c"
00:26:37	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a5e96bc702bc529b424e6c80f95d7d4fc4fe92f83df4a77c3b47eb3a30fe729"
00:26:37	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a"
00:26:37	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:007ba215236827a40e1b33f3799d289065305ae886c05e51214d74d0ff24d62d" in 6.057s (6.057s including waiting). Image size: 341105288 bytes.
00:26:37	openshift-image-registry	kubelet	node-ca-2jtx2	Created	Container created
00:26:37	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Started	Container started
00:26:38	openshift-network-operator	kubelet	iptables-alerter-h22zx	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" in 9.146s (9.146s including waiting). Image size: 412187488 bytes.
00:26:38	openshift-multus	kubelet	multus-mw7mj	Created	Container created
00:26:38	openshift-dns	kubelet	node-resolver-w7sds	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" in 8.866s (8.866s including waiting). Image size: 412187488 bytes.
00:26:38	openshift-multus	kubelet	multus-mw7mj	Started	Container started
00:26:38	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:007ba215236827a40e1b33f3799d289065305ae886c05e51214d74d0ff24d62d"
00:26:38	openshift-dns	kubelet	node-resolver-w7sds	Created	Container created
00:26:38	openshift-dns	kubelet	node-resolver-w7sds	Started	Container started
00:26:38	openshift-cluster-node-tuning-operator	kubelet	tuned-mdc9b	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c"
00:26:38	openshift-multus	kubelet	multus-mw7mj	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0" in 8.667s (8.667s including waiting). Image size: 416227973 bytes.
00:26:38	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c4db2cbbaecb77e6b3a4e8dd7ee7a4d4fa9ab69787e4330711a3abb1277af2ac"
00:26:38	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Started	Container started
00:26:38	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Created	Container created
00:26:38	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a5e96bc702bc529b424e6c80f95d7d4fc4fe92f83df4a77c3b47eb3a30fe729" in 1.946s (1.946s including waiting). Image size: 226041023 bytes.
00:26:39	openshift-network-operator	kubelet	iptables-alerter-h22zx	Started	Container started
00:26:39	openshift-multus	kubelet	multus-cxrhl	Started	Container started
00:26:39	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Started	Container started
00:26:39	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a5e96bc702bc529b424e6c80f95d7d4fc4fe92f83df4a77c3b47eb3a30fe729" in 1.773s (1.773s including waiting). Image size: 226041023 bytes.
00:26:39	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c4db2cbbaecb77e6b3a4e8dd7ee7a4d4fa9ab69787e4330711a3abb1277af2ac" in 1.581s (1.581s including waiting). Image size: 226261679 bytes.
00:26:39	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c4db2cbbaecb77e6b3a4e8dd7ee7a4d4fa9ab69787e4330711a3abb1277af2ac"
00:26:39	openshift-multus	kubelet	multus-cxrhl	Created	Container created
00:26:39	openshift-multus	kubelet	multus-cxrhl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0" in 8.188s (8.188s including waiting). Image size: 416227973 bytes.
00:26:39	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe6e5decc2a69ebef017fc4610e9fbfcd0425d14176b528829f3c5091556205b" in 4.755s (4.755s including waiting). Image size: 327138248 bytes.
00:26:39	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Created	Container created
00:26:39	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Started	Container started
00:26:39	openshift-network-operator	kubelet	iptables-alerter-zpf48	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" in 8.49s (8.49s including waiting). Image size: 412187488 bytes.
00:26:39	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Created	Container created
00:26:39	openshift-network-operator	kubelet	iptables-alerter-h22zx	Created	Container created
00:26:40	openshift-cluster-node-tuning-operator	kubelet	tuned-9mfzm	Started	Container started
00:26:40 (x25)	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	(combined from similar events): Status for clusteroperator/storage changed: Available changed from False to True ("DefaultStorageClassControllerAvailable: StorageClass provided by supplied CSI Driver instead of the cluster-storage-operator\nAWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: DaemonSet is available\nAWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverControllerServiceControllerAvailable: Deployment is available")
00:26:40	openshift-dns	kubelet	node-resolver-fkt8d	Started	Container started
00:26:40	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe6e5decc2a69ebef017fc4610e9fbfcd0425d14176b528829f3c5091556205b" in 4.799s (4.799s including waiting). Image size: 327138248 bytes.
00:26:40	openshift-dns	kubelet	node-resolver-fkt8d	Created	Container created
00:26:40	openshift-dns	kubelet	node-resolver-fkt8d	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" in 8.633s (8.633s including waiting). Image size: 412187488 bytes.
00:26:40	openshift-cluster-node-tuning-operator	kubelet	tuned-9mfzm	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c" in 11.587s (11.587s including waiting). Image size: 571859054 bytes.
00:26:40	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Started	Container started
00:26:40	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Created	Container created
00:26:40	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d8f1d47be7e464a444088569f39f0cf6f974e562eae0e0c473d22e80c1edb5"
00:26:40	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-8h5z9	Created	Container created
00:26:40	openshift-cluster-node-tuning-operator	kubelet	tuned-9mfzm	Created	Container created
00:26:40	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65a324fc19ef3da53cecb9dc13e0c07696c595996d3c07d1a5dfd427f6a61e6e" in 3.449s (3.449s including waiting). Image size: 243835914 bytes.
00:26:40	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Started	Container started
00:26:41	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Started	Container started
00:26:41	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Created	Container created
00:26:41	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Started	Container started
00:26:41	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Created	Container created
00:26:41	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d8f1d47be7e464a444088569f39f0cf6f974e562eae0e0c473d22e80c1edb5" in 1.254s (1.254s including waiting). Image size: 203442718 bytes.
00:26:41	openshift-network-operator	kubelet	iptables-alerter-zpf48	Created	Container created
00:26:41	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d8f1d47be7e464a444088569f39f0cf6f974e562eae0e0c473d22e80c1edb5"
00:26:41	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Started	Container started
00:26:41	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Created	Container created
00:26:41	openshift-network-operator	kubelet	iptables-alerter-zpf48	Started	Container started
00:26:41	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-pjnxn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c4db2cbbaecb77e6b3a4e8dd7ee7a4d4fa9ab69787e4330711a3abb1277af2ac" in 1.477s (1.477s including waiting). Image size: 226261679 bytes.
00:26:42	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Started	Container started
00:26:42	openshift-cluster-node-tuning-operator	kubelet	tuned-d6cwn	Started	Container started
00:26:42	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0176b4589c78e69f00e9d870f79777da63ed33b8dd28f973064668d8c97ed76"
00:26:42	openshift-cluster-node-tuning-operator	kubelet	tuned-d6cwn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c" in 10.571s (10.571s including waiting). Image size: 571859054 bytes.
00:26:42	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Created	Container created
00:26:42	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d8f1d47be7e464a444088569f39f0cf6f974e562eae0e0c473d22e80c1edb5" in 1.169s (1.169s including waiting). Image size: 203442718 bytes.
00:26:42	openshift-cluster-node-tuning-operator	kubelet	tuned-d6cwn	Created	Container created
00:26:42	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe6e5decc2a69ebef017fc4610e9fbfcd0425d14176b528829f3c5091556205b"
00:26:43	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0176b4589c78e69f00e9d870f79777da63ed33b8dd28f973064668d8c97ed76" in 1.127s (1.127s including waiting). Image size: 202006356 bytes.
00:26:43	openshift-image-registry	kubelet	node-ca-2l6ct	Started	Container started
00:26:43	openshift-image-registry	kubelet	node-ca-2l6ct	Created	Container created
00:26:43	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0176b4589c78e69f00e9d870f79777da63ed33b8dd28f973064668d8c97ed76"
00:26:43	openshift-image-registry	kubelet	node-ca-2l6ct	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c" in 6.123s (6.123s including waiting). Image size: 314097073 bytes.
00:26:43	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Created	Container created
00:26:43	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Started	Container started
00:26:44	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Created	Container created
00:26:44	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Started	Container started
00:26:44	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0176b4589c78e69f00e9d870f79777da63ed33b8dd28f973064668d8c97ed76" in 1.447s (1.447s including waiting). Image size: 202006356 bytes.
00:26:44	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:007ba215236827a40e1b33f3799d289065305ae886c05e51214d74d0ff24d62d" in 6.591s (6.591s including waiting). Image size: 341105288 bytes.
00:26:44 (x6)	openshift-multus	kubelet	network-metrics-daemon-gqvhh	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : object "openshift-multus"/"metrics-daemon-secret" not registered
00:26:44 (x6)	openshift-network-diagnostics	kubelet	network-check-target-9xnql	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-fz7mj" : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
00:26:44	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4"
00:26:45	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Created	Container created
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" in 16.504s (16.504s including waiting). Image size: 1174963065 bytes.
00:26:45	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Started	Container started
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:45	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4"
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:45	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a5e96bc702bc529b424e6c80f95d7d4fc4fe92f83df4a77c3b47eb3a30fe729"
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:45	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:46	openshift-multus	kubelet	multus-4rhrt	Created	Container created
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" in 15.065s (15.065s including waiting). Image size: 1174963065 bytes.
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:46 (x6)	openshift-multus	kubelet	network-metrics-daemon-2vxt5	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : object "openshift-multus"/"metrics-daemon-secret" not registered
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:46	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a5e96bc702bc529b424e6c80f95d7d4fc4fe92f83df4a77c3b47eb3a30fe729" in 1.85s (1.85s including waiting). Image size: 226041023 bytes.
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:46	openshift-multus	kubelet	multus-4rhrt	Started	Container started
00:26:46	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:46	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Started	Container started
00:26:46	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Created	Container created
00:26:46	openshift-multus	kubelet	multus-4rhrt	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0" in 9.101s (9.101s including waiting). Image size: 416227973 bytes.
00:26:46	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4" in 1.903s (1.903s including waiting). Image size: 287286014 bytes.
00:26:46 (x6)	openshift-network-diagnostics	kubelet	network-check-target-8km4w	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-kb8cp" : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
00:26:46	openshift-dns	kubelet	node-resolver-9lcsd	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" in 9.105s (9.105s including waiting). Image size: 412187488 bytes.
00:26:46	openshift-dns	kubelet	node-resolver-9lcsd	Created	Container created
00:26:46	openshift-dns	kubelet	node-resolver-9lcsd	Started	Container started
00:26:46	openshift-network-operator	kubelet	iptables-alerter-mgskf	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" in 9.57s (9.57s including waiting). Image size: 412187488 bytes.
00:26:47	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c4db2cbbaecb77e6b3a4e8dd7ee7a4d4fa9ab69787e4330711a3abb1277af2ac"
00:26:47	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Started	Container started
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d8f1d47be7e464a444088569f39f0cf6f974e562eae0e0c473d22e80c1edb5"
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Created	Container created
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Started	Container started
00:26:47	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Created	Container created
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4" already present on machine and can be accessed by the pod
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Created	Container created
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Started	Container started
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Started	Container started
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4" in 1.966s (1.966s including waiting). Image size: 287286014 bytes.
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Created	Container created
00:26:47	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:47	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:47	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:47	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe6e5decc2a69ebef017fc4610e9fbfcd0425d14176b528829f3c5091556205b" in 4.592s (4.592s including waiting). Image size: 327138248 bytes.
00:26:48	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:48	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:48	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:48	openshift-network-operator	kubelet	iptables-alerter-mgskf	Created	Container created
00:26:48	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4" already present on machine and can be accessed by the pod
00:26:48	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Created	Container created
00:26:48	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Created	Container created
00:26:48	openshift-network-operator	kubelet	iptables-alerter-mgskf	Started	Container started
00:26:48	openshift-multus	kubelet	multus-additional-cni-plugins-wcpdn	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0" already present on machine and can be accessed by the pod
00:26:48	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Started	Container started
00:26:49	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c4db2cbbaecb77e6b3a4e8dd7ee7a4d4fa9ab69787e4330711a3abb1277af2ac" in 2.003s (2.003s including waiting). Image size: 226261679 bytes.
00:26:49	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Created	Container created
00:26:49	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d8f1d47be7e464a444088569f39f0cf6f974e562eae0e0c473d22e80c1edb5" in 1.613s (1.613s including waiting). Image size: 203442718 bytes.
00:26:49	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Created	Container created
00:26:49	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:49	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Created	Container created
00:26:49	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Started	Container started
00:26:49	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0176b4589c78e69f00e9d870f79777da63ed33b8dd28f973064668d8c97ed76"
00:26:49	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Created	Container created
00:26:49	openshift-cluster-node-tuning-operator	kubelet	tuned-mdc9b	Started	Container started
00:26:49	openshift-multus	kubelet	multus-additional-cni-plugins-mf6df	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0" already present on machine and can be accessed by the pod
00:26:49	openshift-ovn-kubernetes	kubelet	ovnkube-node-wlldw	Started	Container started
00:26:49	openshift-cluster-node-tuning-operator	kubelet	tuned-mdc9b	Created	Container created
00:26:49	openshift-cluster-node-tuning-operator	kubelet	tuned-mdc9b	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c" in 10.817s (10.817s including waiting). Image size: 571859054 bytes.
00:26:49	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-g96m5	Started	Container started
00:26:50	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0176b4589c78e69f00e9d870f79777da63ed33b8dd28f973064668d8c97ed76" in 1.06s (1.06s including waiting). Image size: 202006356 bytes.
00:26:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Started	Container started
00:26:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Created	Container created
00:26:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-qmx5k	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:51	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Created	Container created
00:26:51	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Started	Container started
00:26:51	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4"
00:26:52 (x6)	openshift-network-diagnostics	kubelet	network-check-target-nj7c4	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-gfq8b" : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
00:26:52 (x6)	openshift-multus	kubelet	network-metrics-daemon-jw8gx	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : object "openshift-multus"/"metrics-daemon-secret" not registered
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" in 15.952s (15.952s including waiting). Image size: 1174963065 bytes.
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:26:54	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Started	Container started
00:26:54	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4" in 2.2s (2.2s including waiting). Image size: 287286014 bytes.
00:26:54	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Started	Container started
00:26:54	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Created	Container created
00:26:54	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5ce17208794ef1bb14827732e0adbd65988fe156c8ab5e578ec8afd19fa1fca4" already present on machine and can be accessed by the pod
00:26:54	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Created	Container created
00:26:55	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:55	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:55	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:55	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b14b49cabfdc258931fa03823e067322606fe50d514622d8c4f0efaadb17d1f0" already present on machine and can be accessed by the pod
00:26:55	openshift-multus	kubelet	multus-additional-cni-plugins-2ckv6	Created	Container created
00:26:56 (x16)	openshift-network-diagnostics	kubelet	network-check-target-9xnql	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
00:26:56 (x16)	openshift-multus	kubelet	network-metrics-daemon-gqvhh	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
00:26:57	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Created	Container created
00:26:57	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a" already present on machine and can be accessed by the pod
00:26:57	openshift-ovn-kubernetes	kubelet	ovnkube-node-gzk2m	Started	Container started
00:26:58	openshift-ingress-canary	multus	ingress-canary-bq5tp	AddedInterface	Add eth0 [10.132.0.21/23] from ovn-kubernetes
00:26:58	openshift-dns	daemonset-controller	dns-default	SuccessfulCreate	Created pod: dns-default-6p5xt
00:26:58	openshift-service-ca-operator	multus	service-ca-operator-544d749c8c-bkjl8	AddedInterface	Add eth0 [10.132.0.20/23] from ovn-kubernetes
00:26:58	openshift-ingress-canary	daemonset-controller	ingress-canary	SuccessfulCreate	Created pod: ingress-canary-bq5tp
00:26:58	openshift-insights	multus	insights-operator-7c4986d449-8x7tk	AddedInterface	Add eth0 [10.132.0.11/23] from ovn-kubernetes
00:26:58	openshift-cluster-storage-operator	multus	volume-data-source-validator-58c9f5f46d-6hgmr	AddedInterface	Add eth0 [10.132.0.12/23] from ovn-kubernetes
00:26:58	openshift-console-operator	multus	console-operator-7cd56b8dbc-bwtwg	AddedInterface	Add eth0 [10.132.0.16/23] from ovn-kubernetes
00:26:58	openshift-kube-storage-version-migrator-operator	multus	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	AddedInterface	Add eth0 [10.132.0.15/23] from ovn-kubernetes
00:26:58	openshift-insights	kubelet	insights-operator-7c4986d449-8x7tk	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4f6a06f8fd2e41c1080f083d1fd9114deee35547a92f4e3cf5bdaf6d1a72aa7"
00:26:58	openshift-network-diagnostics	multus	network-check-source-6f78d59f99-knrbl	AddedInterface	Add eth0 [10.132.0.18/23] from ovn-kubernetes
00:26:59 (x16)	openshift-multus	kubelet	network-metrics-daemon-2vxt5	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
00:26:59	openshift-service-ca-operator	kubelet	service-ca-operator-544d749c8c-bkjl8	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9cb8e7495661fc6305dc7c76cb7758febf03346c441c2bb87f31f1c3f478b693"
00:26:59	openshift-dns	daemonset-controller	dns-default	SuccessfulCreate	Created pod: dns-default-b75ck
00:26:59	openshift-ingress-canary	kubelet	ingress-canary-bq5tp	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bb08b4955abf8a0ffea0e4f2e446fbb6a5f3271312a996633901621b91b106ab"
00:26:59	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a7ff21366c49c56f787177bd69e6699a09d5ab69ce22d52bfd6a013e1e252b"
00:26:59	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6adea7dd46814e9cda452b4db098f13c5ab6c9eb0f5671ddb1154ef49c36ec5d"
00:26:59 (x16)	openshift-network-diagnostics	kubelet	network-check-target-8km4w	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
00:26:59	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-58c9f5f46d-6hgmr	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe35f0f58a6b27b49f0a4921d73cd1a16fdce7a56d5e00be9ca1405bf3875539"
00:26:59	openshift-network-diagnostics	kubelet	network-check-source-6f78d59f99-knrbl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20"
00:26:59	openshift-ingress-canary	daemonset-controller	ingress-canary	SuccessfulCreate	Created pod: ingress-canary-9vqsh
00:27:00	openshift-ingress-canary	multus	ingress-canary-9vqsh	AddedInterface	Add eth0 [10.133.0.6/23] from ovn-kubernetes
00:27:00	openshift-ingress-canary	kubelet	ingress-canary-9vqsh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bb08b4955abf8a0ffea0e4f2e446fbb6a5f3271312a996633901621b91b106ab"
00:27:00	openshift-multus	kubelet	network-metrics-daemon-gqvhh	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "metrics-daemon-secret" not found
00:27:00	openshift-network-diagnostics	kubelet	network-check-target-9xnql	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20"
00:27:00	openshift-network-diagnostics	multus	network-check-target-9xnql	AddedInterface	Add eth0 [10.132.0.3/23] from ovn-kubernetes
00:27:01	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-58c9f5f46d-6hgmr	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe35f0f58a6b27b49f0a4921d73cd1a16fdce7a56d5e00be9ca1405bf3875539" in 2.587s (2.587s including waiting). Image size: 238319872 bytes.
00:27:01	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-58c9f5f46d-6hgmr	Created	Container created
00:27:01	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-58c9f5f46d-6hgmr	Started	Container started
00:27:02	openshift-cluster-storage-operator	deployment-controller	volume-data-source-validator	ScalingReplicaSet	Scaled down replica set volume-data-source-validator-57b896c65c from 1 to 0
00:27:02	openshift-cluster-storage-operator	data-source-validator-leader/volume-data-source-validator-58c9f5f46d-6hgmr	data-source-validator-leader	LeaderElection	volume-data-source-validator-58c9f5f46d-6hgmr became leader
00:27:02	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-57b896c65c	SuccessfulDelete	Deleted pod: volume-data-source-validator-57b896c65c-zttnm
00:27:02	openshift-multus	kubelet	network-metrics-daemon-2vxt5	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "metrics-daemon-secret" not found
00:27:03	openshift-network-diagnostics	multus	network-check-target-8km4w	AddedInterface	Add eth0 [10.133.0.3/23] from ovn-kubernetes
00:27:03	openshift-network-diagnostics	kubelet	network-check-target-8km4w	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20"
00:27:03	openshift-ingress-canary	kubelet	ingress-canary-9vqsh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bb08b4955abf8a0ffea0e4f2e446fbb6a5f3271312a996633901621b91b106ab" in 2.898s (2.898s including waiting). Image size: 403426785 bytes.
00:27:03	openshift-ingress-canary	kubelet	ingress-canary-9vqsh	Created	Container created
00:27:03	openshift-ingress-canary	kubelet	ingress-canary-9vqsh	Started	Container started
00:27:04 (x15)	openshift-network-diagnostics	kubelet	network-check-target-nj7c4	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
00:27:04	openshift-insights	kubelet	insights-operator-7c4986d449-8x7tk	Started	Container started
00:27:04 (x16)	openshift-multus	kubelet	network-metrics-daemon-jw8gx	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
00:27:04	openshift-insights	kubelet	insights-operator-7c4986d449-8x7tk	Created	Container created
00:27:04	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6adea7dd46814e9cda452b4db098f13c5ab6c9eb0f5671ddb1154ef49c36ec5d" in 5.854s (5.854s including waiting). Image size: 349181921 bytes.
00:27:04	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a7ff21366c49c56f787177bd69e6699a09d5ab69ce22d52bfd6a013e1e252b" in 5.464s (5.464s including waiting). Image size: 323377727 bytes.
00:27:04	openshift-insights	kubelet	insights-operator-7c4986d449-8x7tk	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4f6a06f8fd2e41c1080f083d1fd9114deee35547a92f4e3cf5bdaf6d1a72aa7" in 5.505s (5.505s including waiting). Image size: 341682738 bytes.
00:27:05	openshift-insights	openshift-insights-operator	insights-operator	DaemonSet Updated	Runtime extractor DaemonSet openshift-insights/insights-runtime-extractor was created or updated
00:27:05	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Created	Container created
00:27:05	openshift-service-ca-operator	kubelet	service-ca-operator-544d749c8c-bkjl8	Started	Container started
00:27:05	openshift-insights	openshift-insights-operator	insights-operator	DaemonSetCreated	Created DaemonSet.apps/insights-runtime-extractor -n openshift-insights because it was missing
00:27:05	openshift-insights	daemonset-controller	insights-runtime-extractor	SuccessfulCreate	Created pod: insights-runtime-extractor-jbbjm
00:27:05	openshift-insights	daemonset-controller	insights-runtime-extractor	SuccessfulCreate	Created pod: insights-runtime-extractor-xhcgv
00:27:05 (x2)	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Started	Container started
00:27:05	openshift-insights	openshift-insights-operator	insights-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:27:05	openshift-service-ca-operator	kubelet	service-ca-operator-544d749c8c-bkjl8	Created	Container created
00:27:05	openshift-service-ca-operator	kubelet	service-ca-operator-544d749c8c-bkjl8	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9cb8e7495661fc6305dc7c76cb7758febf03346c441c2bb87f31f1c3f478b693" in 6.29s (6.29s including waiting). Image size: 360230673 bytes.
00:27:05	openshift-ingress-canary	kubelet	ingress-canary-bq5tp	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bb08b4955abf8a0ffea0e4f2e446fbb6a5f3271312a996633901621b91b106ab" in 6.89s (6.89s including waiting). Image size: 403426785 bytes.
00:27:05	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Started	Container started
00:27:05	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a7ff21366c49c56f787177bd69e6699a09d5ab69ce22d52bfd6a013e1e252b" already present on machine and can be accessed by the pod
00:27:05 (x2)	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Created	Container created
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Degraded changed from Unknown to False ("All is well")
00:27:06 (x5)	openshift-ingress	kubelet	router-default-b48ff49b9-v8tjs	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
00:27:06	openshift-insights	job-controller	periodic-gathering-894dj	SuccessfulCreate	Created pod: periodic-gathering-894dj-29wl8
00:27:06	openshift-service-ca-operator	service-ca-operator	service-ca-operator-lock	LeaderElection	service-ca-operator-544d749c8c-bkjl8_a8b49ca4-9a4e-4df0-9897-f8688c3e5752 became leader
00:27:06	openshift-insights	multus	periodic-gathering-894dj-29wl8	AddedInterface	Add eth0 [10.133.0.9/23] from ovn-kubernetes
00:27:06 (x5)	openshift-monitoring	kubelet	cluster-monitoring-operator-884576c57-nqmlz	FailedMount	MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" : secret "cluster-monitoring-operator-tls" not found
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-lock	LeaderElection	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24_59e49b9a-8947-4b46-8bc9-7f41f754219b became leader
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/migrator -n openshift-kube-storage-version-migrator because it was missing
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/default-deny -n openshift-kube-storage-version-migrator because it was missing
00:27:06	openshift-insights	daemonset-controller	insights-runtime-extractor	SuccessfulCreate	Created pod: insights-runtime-extractor-9fbs4
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Progressing message changed from "KubeStorageVersionMigratorProgressing: Waiting for Deployment to act on changes" to "KubeStorageVersionMigratorProgressing: Waiting for Deployment to deploy pods"
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/allow-migrator -n openshift-kube-storage-version-migrator because it was missing
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Progressing changed from Unknown to True ("KubeStorageVersionMigratorProgressing: Waiting for Deployment to act on changes"),Available changed from Unknown to False ("KubeStorageVersionMigratorAvailable: Waiting for Deployment")
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/storage-version-migration-migrator because it was missing
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	ServiceAccountCreated	Created ServiceAccount/kube-storage-version-migrator-sa -n openshift-kube-storage-version-migrator because it was missing
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Upgradeable changed from Unknown to True ("All is well")
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigrator-deployment-controller--kubestorageversionmigrator	kube-storage-version-migrator-operator	DeploymentCreated	Created Deployment.apps/migrator -n openshift-kube-storage-version-migrator because it was missing
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	NamespaceCreated	Created Namespace/openshift-kube-storage-version-migrator because it was missing
00:27:06	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Degraded set to Unknown (""),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown (""),status.versions changed from [] to [{"operator" "4.22.20"}]
00:27:06 (x2)	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorVersionChanged	clusteroperator/kube-storage-version-migrator version "operator" changed from "" to "4.22.20"
00:27:06	openshift-kube-storage-version-migrator	deployment-controller	migrator	ScalingReplicaSet	Scaled up replica set migrator-66df5d496b from 0 to 2
00:27:06	openshift-kube-storage-version-migrator	replicaset-controller	migrator-66df5d496b	SuccessfulCreate	Created pod: migrator-66df5d496b-k4jqv
00:27:06	openshift-kube-storage-version-migrator	replicaset-controller	migrator-66df5d496b	SuccessfulCreate	Created pod: migrator-66df5d496b-tbzhs
00:27:06 (x4)	openshift-kube-storage-version-migrator	replicaset-controller	migrator-66df5d496b	FailedCreate	Error creating: pods "migrator-66df5d496b-" is forbidden: unable to validate against any security context constraint: provider "nonroot-v2": Forbidden: not usable by user or serviceaccount
00:27:06	openshift-kube-storage-version-migrator	replicaset-controller	migrator-66df5d496b	FailedCreate	Error creating: pods "migrator-66df5d496b-" is forbidden: error looking up service account openshift-kube-storage-version-migrator/kube-storage-version-migrator-sa: serviceaccount "kube-storage-version-migrator-sa" not found
00:27:06 (x5)	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	FailedMount	MountVolume.SetUp failed for volume "samples-operator-tls" : secret "samples-operator-tls" not found
00:27:06 (x5)	openshift-dns	kubelet	dns-default-6p5xt	FailedMount	MountVolume.SetUp failed for volume "metrics-tls" : secret "dns-default-metrics-tls" not found
00:27:06	openshift-ingress-canary	kubelet	ingress-canary-bq5tp	Started	Container started
00:27:06	openshift-ingress-canary	kubelet	ingress-canary-bq5tp	Created	Container created
00:27:06	openshift-dns	daemonset-controller	dns-default	SuccessfulCreate	Created pod: dns-default-9v4jh
00:27:06 (x5)	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	FailedMount	MountVolume.SetUp failed for volume "registry-tls" : secret "image-registry-tls" not found
00:27:06	openshift-ingress-canary	daemonset-controller	ingress-canary	SuccessfulCreate	Created pod: ingress-canary-qg288
00:27:06	openshift-service-ca-operator	service-ca-operator	service-ca-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:27:06	openshift-network-diagnostics	kubelet	network-check-source-6f78d59f99-knrbl	Started	Container started
00:27:06 (x5)	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	FailedMount	MountVolume.SetUp failed for volume "registry-tls" : secret "image-registry-tls" not found
00:27:06	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-storage-version-migrator namespace
00:27:06	openshift-network-diagnostics	kubelet	network-check-source-6f78d59f99-knrbl	Created	Container created
00:27:06	openshift-network-diagnostics	kubelet	network-check-source-6f78d59f99-knrbl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20" in 7.182s (7.182s including waiting). Image size: 440697007 bytes.
00:27:06 (x5)	openshift-network-console	kubelet	networking-console-plugin-86c478bb88-v4tzv	FailedMount	MountVolume.SetUp failed for volume "networking-console-plugin-cert" : secret "networking-console-plugin-cert" not found
00:27:06 (x5)	openshift-ingress	kubelet	router-default-b48ff49b9-v8tjs	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
00:27:07	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Degraded set to Unknown (""),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown (""),status.relatedObjects changed from [] to [{"operator.openshift.io" "servicecas" "" "cluster"} {"" "namespaces" "" "openshift-config"} {"" "namespaces" "" "openshift-config-managed"} {"" "namespaces" "" "openshift-service-ca-operator"} {"" "namespaces" "" "openshift-service-ca"}]
00:27:07	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/system:openshift:controller:service-ca because it was missing
00:27:07	openshift-network-diagnostics	kubelet	network-check-target-9xnql	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20" in 6.36s (6.36s including waiting). Image size: 440697007 bytes.
00:27:07	openshift-insights	kubelet	periodic-gathering-894dj-29wl8	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4f6a06f8fd2e41c1080f083d1fd9114deee35547a92f4e3cf5bdaf6d1a72aa7"
00:27:07	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-service-ca namespace
00:27:07 (x3)	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	FailedMount	MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" : secret "insights-runtime-extractor-tls" not found
00:27:07	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/system:openshift:controller:service-ca because it was missing
00:27:07 (x5)	openshift-dns	kubelet	dns-default-b75ck	FailedMount	MountVolume.SetUp failed for volume "metrics-tls" : secret "dns-default-metrics-tls" not found
00:27:07	openshift-kube-storage-version-migrator	multus	migrator-66df5d496b-k4jqv	AddedInterface	Add eth0 [10.132.0.24/23] from ovn-kubernetes
00:27:07	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-k4jqv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c80e4ba4ff1d887d5a7e32714cbb16f878875a4773c038e49c7efb9490fa674"
00:27:07 (x3)	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	FailedMount	MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" : configmap "kube-rbac-proxy" not found
00:27:07 (x3)	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	FailedMount	MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" : secret "insights-runtime-extractor-tls" not found
00:27:07	openshift-service-ca-operator	service-ca-operator	service-ca-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/system:openshift:controller:service-ca -n openshift-service-ca because it was missing
00:27:07	openshift-service-ca-operator	service-ca-operator	service-ca-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/system:openshift:controller:service-ca -n openshift-service-ca because it was missing
00:27:07	openshift-network-diagnostics	kubelet	network-check-target-9xnql	Created	Container created
00:27:07	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ServiceAccountCreated	Created ServiceAccount/service-ca -n openshift-service-ca because it was missing
00:27:07	openshift-ingress-canary	kubelet	ingress-canary-qg288	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bb08b4955abf8a0ffea0e4f2e446fbb6a5f3271312a996633901621b91b106ab"
00:27:07	openshift-ingress-canary	multus	ingress-canary-qg288	AddedInterface	Add eth0 [10.134.0.7/23] from ovn-kubernetes
00:27:07	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-tbzhs	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c80e4ba4ff1d887d5a7e32714cbb16f878875a4773c038e49c7efb9490fa674"
00:27:07	openshift-kube-storage-version-migrator	multus	migrator-66df5d496b-tbzhs	AddedInterface	Add eth0 [10.133.0.10/23] from ovn-kubernetes
00:27:07	openshift-service-ca-operator	service-ca-operator	service-ca-operator	NamespaceCreated	Created Namespace/openshift-service-ca because it was missing
00:27:07	openshift-network-diagnostics	kubelet	network-check-target-9xnql	Started	Container started
00:27:07 (x3)	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	FailedMount	MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" : configmap "kube-rbac-proxy" not found
00:27:07	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Degraded changed from Unknown to False ("All is well")
00:27:08 (x3)	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	BackOff	Back-off restarting failed container console-operator in pod console-operator-7cd56b8dbc-bwtwg_openshift-console-operator(f5f86383-63f2-41d2-b01e-9dd5b1d4bd08)
00:27:08	openshift-service-ca-operator	service-ca-operator	service-ca-operator	DeploymentUpdated	Updated Deployment.apps/service-ca -n openshift-service-ca because it changed
00:27:08 (x3)	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	FailedMount	MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" : configmap "kube-rbac-proxy" not found
00:27:08	openshift-service-ca	replicaset-controller	service-ca-5fffc97bdf	SuccessfulCreate	Created pod: service-ca-5fffc97bdf-9jbck
00:27:08	openshift-network-diagnostics	kubelet	network-check-target-8km4w	Created	Container created
00:27:08	openshift-network-diagnostics	kubelet	network-check-target-8km4w	Started	Container started
00:27:08	openshift-network-diagnostics	kubelet	network-check-target-8km4w	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20" in 4.744s (4.744s including waiting). Image size: 440697007 bytes.
00:27:08	openshift-service-ca-operator	service-ca-operator-resource-sync-controller-resourcesynccontroller	service-ca-operator	ConfigMapCreated	Created ConfigMap/service-ca -n openshift-config-managed because it was missing
00:27:08	openshift-service-ca-operator	service-ca-operator	service-ca-operator	DeploymentCreated	Created Deployment.apps/service-ca -n openshift-service-ca because it was missing
00:27:08	openshift-service-ca	multus	service-ca-5fffc97bdf-9jbck	AddedInterface	Add eth0 [10.134.0.9/23] from ovn-kubernetes
00:27:08	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Progressing changed from Unknown to True ("Progressing: \nProgressing: service-ca does not have available replicas"),Available changed from Unknown to True ("All is well"),Upgradeable changed from Unknown to True ("All is well")
00:27:08	openshift-service-ca-operator	service-ca-operator	service-ca-operator	SecretCreated	Created Secret/signing-key -n openshift-service-ca because it was missing
00:27:08	openshift-service-ca	deployment-controller	service-ca	ScalingReplicaSet	Scaled up replica set service-ca-5fffc97bdf from 0 to 1
00:27:08	openshift-multus	kubelet	network-metrics-daemon-jw8gx	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "metrics-daemon-secret" not found
00:27:08	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ConfigMapCreated	Created ConfigMap/signing-cabundle -n openshift-service-ca because it was missing
00:27:09	openshift-network-diagnostics	multus	network-check-target-nj7c4	AddedInterface	Add eth0 [10.134.0.4/23] from ovn-kubernetes
00:27:09	openshift-service-ca	kubelet	service-ca-5fffc97bdf-9jbck	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9cb8e7495661fc6305dc7c76cb7758febf03346c441c2bb87f31f1c3f478b693"
00:27:09	openshift-network-diagnostics	kubelet	network-check-target-nj7c4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20"
00:27:10	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-k4jqv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c80e4ba4ff1d887d5a7e32714cbb16f878875a4773c038e49c7efb9490fa674"
00:27:10	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-tbzhs	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c80e4ba4ff1d887d5a7e32714cbb16f878875a4773c038e49c7efb9490fa674"
00:27:10	openshift-insights	kubelet	periodic-gathering-894dj-29wl8	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4f6a06f8fd2e41c1080f083d1fd9114deee35547a92f4e3cf5bdaf6d1a72aa7"
00:27:11	openshift-ingress-canary	kubelet	ingress-canary-qg288	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bb08b4955abf8a0ffea0e4f2e446fbb6a5f3271312a996633901621b91b106ab" in 3.848s (3.848s including waiting). Image size: 403426785 bytes.
00:27:11	openshift-ingress-canary	kubelet	ingress-canary-qg288	Created	Container created
00:27:11	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-k4jqv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c80e4ba4ff1d887d5a7e32714cbb16f878875a4773c038e49c7efb9490fa674" in 768ms (768ms including waiting). Image size: 249015991 bytes.
00:27:11	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-k4jqv	Created	Container created
00:27:11	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-k4jqv	Started	Container started
00:27:11	openshift-ingress-canary	kubelet	ingress-canary-qg288	Started	Container started
00:27:12	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-tbzhs	Started	Container started
00:27:12	openshift-insights	kubelet	periodic-gathering-894dj-29wl8	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4f6a06f8fd2e41c1080f083d1fd9114deee35547a92f4e3cf5bdaf6d1a72aa7" in 1.311s (1.311s including waiting). Image size: 341682738 bytes.
00:27:12	openshift-service-ca	kubelet	service-ca-5fffc97bdf-9jbck	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9cb8e7495661fc6305dc7c76cb7758febf03346c441c2bb87f31f1c3f478b693" in 3.521s (3.521s including waiting). Image size: 360230673 bytes.
00:27:12	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-tbzhs	Created	Container created
00:27:12	openshift-service-ca	kubelet	service-ca-5fffc97bdf-9jbck	Created	Container created
00:27:12	openshift-kube-storage-version-migrator	kubelet	migrator-66df5d496b-tbzhs	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c80e4ba4ff1d887d5a7e32714cbb16f878875a4773c038e49c7efb9490fa674" in 1.312s (1.312s including waiting). Image size: 249015991 bytes.
00:27:12	openshift-service-ca	kubelet	service-ca-5fffc97bdf-9jbck	Started	Container started
00:27:12	openshift-insights	kubelet	periodic-gathering-894dj-29wl8	Started	Container started
00:27:12	openshift-insights	kubelet	periodic-gathering-894dj-29wl8	Created	Container created
00:27:13	openshift-service-ca	service-ca-controller	service-ca-controller-lock	LeaderElection	service-ca-5fffc97bdf-9jbck_d418a63c-e850-4d6f-92a7-cad542b43dc6 became leader
00:27:14 (x4)	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	FailedMount	MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" : secret "insights-runtime-extractor-tls" not found
00:27:14 (x4)	openshift-network-console	kubelet	networking-console-plugin-86c478bb88-v4tzv	FailedMount	MountVolume.SetUp failed for volume "networking-console-plugin-cert" : secret "networking-console-plugin-cert" not found
00:27:14	openshift-network-diagnostics	kubelet	network-check-target-nj7c4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de0b621eadd12352bc31eea371fadea48123ec1fdffee60e179eb210d2f62a20" in 5.519s (5.519s including waiting). Image size: 440697007 bytes.
00:27:14	openshift-network-diagnostics	kubelet	network-check-target-nj7c4	Created	Container created
00:27:14 (x5)	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	FailedMount	MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" : secret "insights-runtime-extractor-tls" not found
00:27:14 (x4)	openshift-ingress	kubelet	router-default-b48ff49b9-v8tjs	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
00:27:14 (x4)	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	FailedMount	MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" : secret "insights-runtime-extractor-tls" not found
00:27:14 (x4)	openshift-monitoring	kubelet	cluster-monitoring-operator-884576c57-nqmlz	FailedMount	MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" : secret "cluster-monitoring-operator-tls" not found
00:27:14 (x5)	openshift-dns	kubelet	dns-default-9v4jh	FailedMount	MountVolume.SetUp failed for volume "metrics-tls" : secret "dns-default-metrics-tls" not found
00:27:14 (x4)	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	FailedMount	MountVolume.SetUp failed for volume "registry-tls" : secret "image-registry-tls" not found
00:27:14	openshift-network-diagnostics	kubelet	network-check-target-nj7c4	Started	Container started
00:27:14 (x4)	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	FailedMount	MountVolume.SetUp failed for volume "samples-operator-tls" : secret "samples-operator-tls" not found
00:27:14 (x4)	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	FailedMount	MountVolume.SetUp failed for volume "registry-tls" : secret "image-registry-tls" not found
00:27:16 (x3)	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	BackOff	Back-off restarting failed container console-operator in pod console-operator-7cd56b8dbc-bwtwg_openshift-console-operator(f5f86383-63f2-41d2-b01e-9dd5b1d4bd08)
00:27:18	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:18	openshift-monitoring	multus	cluster-monitoring-operator-884576c57-nqmlz	AddedInterface	Add eth0 [10.132.0.10/23] from ovn-kubernetes
00:27:18	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Created	Container created
00:27:18	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	Started	Container started
00:27:18 (x5)	openshift-multus	kubelet	network-metrics-daemon-gqvhh	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "metrics-daemon-secret" not found
00:27:18	openshift-insights	multus	insights-runtime-extractor-jbbjm	AddedInterface	Add eth0 [10.132.0.23/23] from ovn-kubernetes
00:27:18	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	Created	Container created
00:27:18	openshift-image-registry	multus	image-registry-dfd9f5756-s9tvc	AddedInterface	Add eth0 [10.132.0.14/23] from ovn-kubernetes
00:27:18	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c" already present on machine and can be accessed by the pod
00:27:18	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	Created	Container created
00:27:18 (x5)	openshift-ingress	kubelet	router-default-b48ff49b9-v8tjs	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
00:27:18	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48d79d299d03d2d6c5f239feade6371eac68034632443999240940047823442d"
00:27:18	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	Started	Container started
00:27:18	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5a0811433e7e328be7ff5f9260923be5bf508002ba7a3cc88f668c6e3baf2e8"
00:27:18 (x5)	openshift-dns	kubelet	dns-default-b75ck	FailedMount	MountVolume.SetUp failed for volume "metrics-tls" : secret "dns-default-metrics-tls" not found
00:27:18 (x5)	openshift-multus	kubelet	network-metrics-daemon-2vxt5	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "metrics-daemon-secret" not found
00:27:18 (x5)	openshift-dns	kubelet	dns-default-6p5xt	FailedMount	MountVolume.SetUp failed for volume "metrics-tls" : secret "dns-default-metrics-tls" not found
00:27:18	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Started	Container started
00:27:18	openshift-monitoring	kubelet	cluster-monitoring-operator-884576c57-nqmlz	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a904df4dfc323d05e2540e1a4978cac0f678428e8ae5158cd05dbbf08cb33638"
00:27:18	openshift-network-console	kubelet	networking-console-plugin-86c478bb88-v4tzv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:469af660c98eb234e0497e5da7bb4d72bd8bee9a83b202a6f7edb50f51ca4ddb"
00:27:18	openshift-network-console	multus	networking-console-plugin-86c478bb88-v4tzv	AddedInterface	Add eth0 [10.132.0.19/23] from ovn-kubernetes
00:27:18	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c" already present on machine and can be accessed by the pod
00:27:18	openshift-image-registry	multus	image-registry-6c9bd86665-k87ds	AddedInterface	Add eth0 [10.132.0.22/23] from ovn-kubernetes
00:27:18	openshift-insights	multus	insights-runtime-extractor-xhcgv	AddedInterface	Add eth0 [10.133.0.8/23] from ovn-kubernetes
00:27:18	openshift-cluster-samples-operator	multus	cluster-samples-operator-6ddb6c8b94-nq7ch	AddedInterface	Add eth0 [10.132.0.13/23] from ovn-kubernetes
00:27:19	openshift-insights	multus	insights-runtime-extractor-9fbs4	AddedInterface	Add eth0 [10.134.0.6/23] from ovn-kubernetes
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Started	Container started
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48d79d299d03d2d6c5f239feade6371eac68034632443999240940047823442d"
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Created	Container created
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48d79d299d03d2d6c5f239feade6371eac68034632443999240940047823442d" in 1.176s (1.176s including waiting). Image size: 207188112 bytes.
00:27:19 (x2)	openshift-multus	kubelet	network-metrics-daemon-jw8gx	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "metrics-daemon-secret" not found
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Created	Container created
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Started	Container started
00:27:19	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48d79d299d03d2d6c5f239feade6371eac68034632443999240940047823442d"
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Started	Container started
00:27:20	openshift-network-console	kubelet	networking-console-plugin-86c478bb88-v4tzv	Created	Container created
00:27:20	openshift-multus	kubelet	network-metrics-daemon-jw8gx	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e754b00a6aa83634000926c6e4dbb8217325a6c12b2fca5c12b8207630be6a6"
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48d79d299d03d2d6c5f239feade6371eac68034632443999240940047823442d" in 996ms (996ms including waiting). Image size: 207188112 bytes.
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Created	Container created
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:996884086eb3d78f09ed8b2437d671de8937cb414a44f8e1b8f596db9a938d3d"
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Created	Container created
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Started	Container started
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:996884086eb3d78f09ed8b2437d671de8937cb414a44f8e1b8f596db9a938d3d"
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48d79d299d03d2d6c5f239feade6371eac68034632443999240940047823442d" in 1.016s (1.016s including waiting). Image size: 207188112 bytes.
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Created	Container created
00:27:20	openshift-multus	multus	network-metrics-daemon-jw8gx	AddedInterface	Add eth0 [10.134.0.5/23] from ovn-kubernetes
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Started	Container started
00:27:20	openshift-monitoring	kubelet	cluster-monitoring-operator-884576c57-nqmlz	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a904df4dfc323d05e2540e1a4978cac0f678428e8ae5158cd05dbbf08cb33638" in 2.282s (2.282s including waiting). Image size: 305255059 bytes.
00:27:20	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:996884086eb3d78f09ed8b2437d671de8937cb414a44f8e1b8f596db9a938d3d"
00:27:20	openshift-network-console	kubelet	networking-console-plugin-86c478bb88-v4tzv	Started	Container started
00:27:20	openshift-network-console	kubelet	networking-console-plugin-86c478bb88-v4tzv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:469af660c98eb234e0497e5da7bb4d72bd8bee9a83b202a6f7edb50f51ca4ddb" in 1.779s (1.779s including waiting). Image size: 242910172 bytes.
00:27:21	openshift-monitoring	kubelet	cluster-monitoring-operator-884576c57-nqmlz	Started	Container started
00:27:21 (x2)	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Started	Container started
00:27:21 (x3)	openshift-image-registry	image-registry-operator	openshift-image-registry	DeploymentUpdated	Updated Deployment.apps/image-registry -n openshift-image-registry because it changed
00:27:21	openshift-kube-controller-manager	cluster-policy-controller-webhook-authenticator-cert-approver-csr-approver-controller-webhookauthenticatorcertapprover_csr-approver-controller		CSRApproval	The CSR "system:openshift:openshift-monitoring-54r85" has been approved
00:27:21	openshift-kube-controller-manager	cluster-policy-controller-webhook-authenticator-cert-approver-csr-approver-controller-webhookauthenticatorcertapprover_csr-approver-controller		CSRApproval	The CSR "system:openshift:openshift-monitoring-rvpv6" has been approved
00:27:21	openshift-monitoring	kubelet	cluster-monitoring-operator-884576c57-nqmlz	Created	Container created
00:27:21	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:27:21	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringclientcertrequester	cluster-monitoring-operator	NoValidCertificateFound	No valid client certificate for OpenShiftMonitoringClientCertRequester is found: unable to parse certificate: data does not contain any valid RSA or ECDSA certificates
00:27:21	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringtelemeterclientcertrequester	cluster-monitoring-operator	NoValidCertificateFound	No valid client certificate for OpenShiftMonitoringTelemeterClientCertRequester is found: unable to parse certificate: data does not contain any valid RSA or ECDSA certificates
00:27:21	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringmetricsserverclientcertrequester	cluster-monitoring-operator	NoValidCertificateFound	No valid client certificate for OpenShiftMonitoringMetricsServerClientCertRequester is found: unable to parse certificate: data does not contain any valid RSA or ECDSA certificates
00:27:21	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringclientcertrequester	cluster-monitoring-operator	CSRCreated	A csr "system:openshift:openshift-monitoring-54r85" is created for OpenShiftMonitoringClientCertRequester
00:27:21	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Unhealthy	Readiness probe failed: Get "https://10.132.0.16:8443/readyz": dial tcp 10.132.0.16:8443: connect: connection refused
00:27:21	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	ProbeError	Readiness probe error: Get "https://10.132.0.16:8443/readyz": dial tcp 10.132.0.16:8443: connect: connection refused body:
00:27:21	openshift-kube-controller-manager	cluster-policy-controller-webhook-authenticator-cert-approver-csr-approver-controller-webhookauthenticatorcertapprover_csr-approver-controller		CSRApproval	The CSR "system:openshift:openshift-monitoring-ms2kk" has been approved
00:27:21 (x2)	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Created	Container created
00:27:21 (x2)	openshift-console-operator	kubelet	console-operator-7cd56b8dbc-bwtwg	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a7ff21366c49c56f787177bd69e6699a09d5ab69ce22d52bfd6a013e1e252b" already present on machine and can be accessed by the pod
00:27:21	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringmetricsserverclientcertrequester	cluster-monitoring-operator	CSRCreated	A csr "system:openshift:openshift-monitoring-rvpv6" is created for OpenShiftMonitoringMetricsServerClientCertRequester
00:27:21	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringtelemeterclientcertrequester	cluster-monitoring-operator	CSRCreated	A csr "system:openshift:openshift-monitoring-ms2kk" is created for OpenShiftMonitoringTelemeterClientCertRequester
00:27:21	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/alert-relabel-configs -n openshift-monitoring because it was missing
00:27:21	openshift-cluster-samples-operator	file-change-watchdog	cluster-samples-operator	FileChangeWatchdogStarted	Started watching files for process cluster-samples-operator[2]
00:27:21	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	Started	Container started
00:27:21	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	Created	Container created
00:27:21	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5a0811433e7e328be7ff5f9260923be5bf508002ba7a3cc88f668c6e3baf2e8" already present on machine and can be accessed by the pod
00:27:21	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	Started	Container started
00:27:21	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	Created	Container created
00:27:21	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-6ddb6c8b94-nq7ch	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5a0811433e7e328be7ff5f9260923be5bf508002ba7a3cc88f668c6e3baf2e8" in 2.622s (2.622s including waiting). Image size: 302246897 bytes.
00:27:22	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/prometheus-operator because it was missing
00:27:22	openshift-multus	kubelet	network-metrics-daemon-jw8gx	Created	Container created
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Created	Container created
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:996884086eb3d78f09ed8b2437d671de8937cb414a44f8e1b8f596db9a938d3d" in 1.908s (1.908s including waiting). Image size: 274270151 bytes.
00:27:22	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/prometheus-operator-admission-webhook -n openshift-monitoring because it was missing
00:27:22	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/prometheus-operator-admission-webhook -n openshift-monitoring because it was missing
00:27:22	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/prometheus-operator because it was missing
00:27:22	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/prometheus-operator -n openshift-monitoring because it was missing
00:27:22	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/metrics-client-ca -n openshift-monitoring because it was missing
00:27:22	openshift-multus	kubelet	network-metrics-daemon-jw8gx	Started	Container started
00:27:22	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/prometheus-operator -n openshift-monitoring because it was missing
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-9fbs4	Started	Container started
00:27:22	openshift-console-operator	console-operator	console-operator-lock	LeaderElection	console-operator-7cd56b8dbc-bwtwg_df304216-b3f3-4c3f-87d1-c99fb9778f82 became leader
00:27:22	openshift-console-operator	console-operator	console-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:27:22	openshift-console-operator	console-operator-health-check-controller-healthcheckcontroller	console-operator	FastControllerResync	Controller "HealthCheckController" resync interval is set to 30s which might lead to client request throttling
00:27:22	openshift-console-operator	console-operator-downloads-pdb-controller-poddisruptionbudgetcontroller	console-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/downloads -n openshift-console because it was missing
00:27:22	openshift-console-operator	console-operator-console-pdb-controller-poddisruptionbudgetcontroller	console-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/console -n openshift-console because it was missing
00:27:22 (x2)	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorVersionChanged	clusteroperator/console version "operator" changed from "" to "4.22.20"
00:27:22	openshift-console-operator	console-operator-resource-sync-controller-resourcesynccontroller	console-operator	ConfigMapCreated	Created ConfigMap/oauth-serving-cert -n openshift-console because it was missing
00:27:22	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded set to False ("All is well"),Progressing set to False ("All is well"),Available set to Unknown (""),Upgradeable set to True ("All is well"),EvaluationConditionsDetected set to Unknown (""),status.relatedObjects changed from [] to [{"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}],status.versions changed from [] to [{"operator" "4.22.20"}]
00:27:22	openshift-console-operator	console-operator-console-downloads-deployment-controller-consoledownloadsdeploymentsynccontroller	console-operator	DeploymentCreated	Created Deployment.apps/downloads -n openshift-console because it was missing
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Started	Container started
00:27:22	openshift-multus	kubelet	network-metrics-daemon-jw8gx	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:22	openshift-multus	kubelet	network-metrics-daemon-jw8gx	Started	Container started
00:27:22	openshift-multus	kubelet	network-metrics-daemon-jw8gx	Created	Container created
00:27:22	openshift-multus	kubelet	network-metrics-daemon-jw8gx	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e754b00a6aa83634000926c6e4dbb8217325a6c12b2fca5c12b8207630be6a6" in 1.469s (1.469s including waiting). Image size: 240530482 bytes.
00:27:22	openshift-console-operator	console-operator-console-service-account-controller-consoleserviceaccountcontroller	console-operator	ServiceAccountCreated	Created ServiceAccount/console -n openshift-console because it was missing
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Created	Container created
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-xhcgv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:996884086eb3d78f09ed8b2437d671de8937cb414a44f8e1b8f596db9a938d3d" in 1.935s (1.935s including waiting). Image size: 274270151 bytes.
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Started	Container started
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Created	Container created
00:27:22	openshift-insights	kubelet	insights-runtime-extractor-jbbjm	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:996884086eb3d78f09ed8b2437d671de8937cb414a44f8e1b8f596db9a938d3d" in 2.121s (2.121s including waiting). Image size: 274270151 bytes.
00:27:22 (x4)	openshift-dns	kubelet	dns-default-9v4jh	FailedMount	MountVolume.SetUp failed for volume "metrics-tls" : secret "dns-default-metrics-tls" not found
00:27:23	openshift-console-operator	console-operator-console-service-controller-consoleservicecontroller	console-operator	ServiceCreated	Created Service/console -n openshift-console because it was missing
00:27:23	openshift-console-operator	console-operator-console-service-controller-consoleservicecontroller	console-operator	ServiceCreated	Created Service/downloads -n openshift-console because it was missing
00:27:23	openshift-console-operator	console-operator-oauthclient-secret-controller-oauthclientsecretcontroller	console-operator	SecretCreated	Created Secret/console-oauth-config -n openshift-console because it was missing
00:27:23	openshift-console-operator	console-operator-resource-sync-controller-resourcesynccontroller	console-operator	ConfigMapCreated	Created ConfigMap/default-ingress-cert -n openshift-console because it was missing
00:27:23	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "OAuthClientsControllerDegraded: route.route.openshift.io \"console\" not found" to "OAuthClientsControllerDegraded: route.route.openshift.io \"console\" not found\nRouteHealthDegraded: route.route.openshift.io \"console\" not found"
00:27:23	openshift-console-operator	console-operator-downloads-service-account-controller-downloadsserviceaccountcontroller	console-operator	ServiceAccountCreated	Created ServiceAccount/downloads -n openshift-console because it was missing
00:27:23	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "All is well" to "OAuthClientsControllerDegraded: route.route.openshift.io \"console\" not found"
00:27:23	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/prometheus-operator-admission-webhook -n openshift-monitoring because it was missing
00:27:26	openshift-dns	kubelet	dns-default-6p5xt	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976"
00:27:26	openshift-multus	multus	network-metrics-daemon-gqvhh	AddedInterface	Add eth0 [10.132.0.4/23] from ovn-kubernetes
00:27:26	openshift-multus	kubelet	network-metrics-daemon-2vxt5	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e754b00a6aa83634000926c6e4dbb8217325a6c12b2fca5c12b8207630be6a6"
00:27:26	openshift-ingress	multus	router-default-b48ff49b9-v8tjs	AddedInterface	Add eth0 [10.132.0.9/23] from ovn-kubernetes
00:27:26	openshift-ingress	kubelet	router-default-b48ff49b9-v8tjs	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod
00:27:26	openshift-ingress	kubelet	router-default-b48ff49b9-v8tjs	Created	Container created
00:27:26	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "OAuthClientsControllerDegraded: route.route.openshift.io \"console\" not found\nRouteHealthDegraded: route.route.openshift.io \"console\" not found" to "OAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev in route console in namespace openshift-console\nRouteHealthDegraded: route.route.openshift.io \"console\" not found"
00:27:26	openshift-ingress	kubelet	router-default-b48ff49b9-v8tjs	Started	Container started
00:27:26	openshift-dns	kubelet	dns-default-b75ck	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976"
00:27:26	openshift-dns	multus	dns-default-b75ck	AddedInterface	Add eth0 [10.133.0.7/23] from ovn-kubernetes
00:27:26	openshift-dns	multus	dns-default-6p5xt	AddedInterface	Add eth0 [10.132.0.8/23] from ovn-kubernetes
00:27:26	openshift-multus	multus	network-metrics-daemon-2vxt5	AddedInterface	Add eth0 [10.133.0.5/23] from ovn-kubernetes
00:27:26	openshift-dns	multus	dns-default-9v4jh	AddedInterface	Add eth0 [10.134.0.8/23] from ovn-kubernetes
00:27:26	openshift-dns	kubelet	dns-default-9v4jh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976"
00:27:26	openshift-multus	kubelet	network-metrics-daemon-gqvhh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e754b00a6aa83634000926c6e4dbb8217325a6c12b2fca5c12b8207630be6a6"
00:27:28	openshift-multus	kubelet	network-metrics-daemon-gqvhh	Created	Container created
00:27:28	openshift-multus	kubelet	network-metrics-daemon-gqvhh	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:28	openshift-multus	kubelet	network-metrics-daemon-gqvhh	Started	Container started
00:27:28	openshift-multus	kubelet	network-metrics-daemon-gqvhh	Created	Container created
00:27:28	openshift-multus	kubelet	network-metrics-daemon-gqvhh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e754b00a6aa83634000926c6e4dbb8217325a6c12b2fca5c12b8207630be6a6" in 1.663s (1.663s including waiting). Image size: 240530482 bytes.
00:27:28	openshift-multus	kubelet	network-metrics-daemon-gqvhh	Started	Container started
00:27:28	openshift-dns	kubelet	dns-default-b75ck	Started	Container started
00:27:28	openshift-dns	kubelet	dns-default-9v4jh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976" in 2.372s (2.372s including waiting). Image size: 310233214 bytes.
00:27:28	openshift-dns	kubelet	dns-default-b75ck	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:28	openshift-dns	kubelet	dns-default-b75ck	Created	Container created
00:27:28	openshift-dns	kubelet	dns-default-b75ck	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976" in 1.982s (1.982s including waiting). Image size: 310233214 bytes.
00:27:29	openshift-dns	kubelet	dns-default-6p5xt	Created	Container created
00:27:29	openshift-dns	kubelet	dns-default-b75ck	Started	Container started
00:27:29	openshift-dns	kubelet	dns-default-9v4jh	Started	Container started
00:27:29	openshift-dns	kubelet	dns-default-9v4jh	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:29	openshift-dns	kubelet	dns-default-6p5xt	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:29	openshift-dns	kubelet	dns-default-9v4jh	Started	Container started
00:27:29	openshift-dns	kubelet	dns-default-b75ck	Created	Container created
00:27:29	openshift-dns	kubelet	dns-default-6p5xt	Started	Container started
00:27:29	openshift-dns	kubelet	dns-default-9v4jh	Created	Container created
00:27:29	openshift-dns	kubelet	dns-default-9v4jh	Created	Container created
00:27:29	openshift-dns	kubelet	dns-default-6p5xt	Created	Container created
00:27:29	openshift-dns	kubelet	dns-default-6p5xt	Started	Container started
00:27:29	openshift-multus	kubelet	network-metrics-daemon-2vxt5	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:29	openshift-multus	kubelet	network-metrics-daemon-2vxt5	Started	Container started
00:27:29	openshift-multus	kubelet	network-metrics-daemon-2vxt5	Created	Container created
00:27:29	openshift-multus	kubelet	network-metrics-daemon-2vxt5	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e754b00a6aa83634000926c6e4dbb8217325a6c12b2fca5c12b8207630be6a6" in 2.964s (2.964s including waiting). Image size: 240530482 bytes.
00:27:29	openshift-dns	kubelet	dns-default-6p5xt	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976" in 2.259s (2.259s including waiting). Image size: 310233214 bytes.
00:27:30	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	DeploymentCreated	Created Deployment.apps/console -n openshift-console because it was missing
00:27:30	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-64c74c7ff7 from 0 to 1
00:27:30	openshift-multus	kubelet	network-metrics-daemon-2vxt5	Created	Container created
00:27:30	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringmetricsserverclientcertrequester	cluster-monitoring-operator	ClientCertificateCreated	A new client certificate for OpenShiftMonitoringMetricsServerClientCertRequester is available
00:27:30	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringclientcertrequester	cluster-monitoring-operator	ClientCertificateCreated	A new client certificate for OpenShiftMonitoringClientCertRequester is available
00:27:30	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringtelemeterclientcertrequester	cluster-monitoring-operator	ClientCertificateCreated	A new client certificate for OpenShiftMonitoringTelemeterClientCertRequester is available
00:27:30	openshift-multus	kubelet	network-metrics-daemon-2vxt5	Started	Container started
00:27:30	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Progressing changed from True to False ("KubeStorageVersionMigratorProgressing: Deployment is not progressing"),Available changed from False to True ("KubeStorageVersionMigratorAvailable: Deployment is available")
00:27:30	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled up replica set image-registry-d98c5d7fb from 0 to 1
00:27:30	openshift-console	replicaset-controller	console-64c74c7ff7	SuccessfulCreate	Created pod: console-64c74c7ff7-k7869
00:27:30	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled down replica set image-registry-dfd9f5756 from 1 to 0
00:27:30	openshift-image-registry	replicaset-controller	image-registry-dfd9f5756	SuccessfulDelete	Deleted pod: image-registry-dfd9f5756-s9tvc
00:27:30	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	Killing	Stopping container registry
00:27:30	openshift-console	replicaset-controller	downloads-6dd789c8b7	SuccessfulCreate	Created pod: downloads-6dd789c8b7-g6lwk
00:27:30	openshift-console	deployment-controller	downloads	ScalingReplicaSet	Scaled up replica set downloads-6dd789c8b7 from 0 to 1
00:27:30	openshift-monitoring	replicaset-controller	prometheus-operator-admission-webhook-6489d8bf89	SuccessfulCreate	Created pod: prometheus-operator-admission-webhook-6489d8bf89-cnzm7
00:27:30	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	ConfigMapCreated	Created ConfigMap/console-config -n openshift-console because it was missing
00:27:30	openshift-monitoring	deployment-controller	prometheus-operator-admission-webhook	ScalingReplicaSet	Scaled up replica set prometheus-operator-admission-webhook-6489d8bf89 from 0 to 1
00:27:30	openshift-image-registry	replicaset-controller	image-registry-d98c5d7fb	SuccessfulCreate	Created pod: image-registry-d98c5d7fb-9p5s7
00:27:30 (x2)	openshift-console	controllermanager	downloads	NoPods	No matching pods found
00:27:30 (x2)	openshift-console	controllermanager	console	NoPods	No matching pods found
00:27:31	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	ConfigMapCreated	Created ConfigMap/console-public -n openshift-config-managed because it was missing
00:27:31	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Progressing changed from True to False ("Progressing: All service-ca-operator deployments updated")
00:27:31	openshift-image-registry	kubelet	image-registry-d98c5d7fb-9p5s7	Started	Container started
00:27:31	openshift-image-registry	kubelet	image-registry-d98c5d7fb-9p5s7	Created	Container created
00:27:31	openshift-image-registry	multus	image-registry-d98c5d7fb-9p5s7	AddedInterface	Add eth0 [10.133.0.11/23] from ovn-kubernetes
00:27:31	openshift-console	kubelet	downloads-6dd789c8b7-g6lwk	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c3da5821b9e51334e9c523aca7fca6a9ef8b853fd4f238b908b086b129619d"
00:27:31	openshift-console	multus	downloads-6dd789c8b7-g6lwk	AddedInterface	Add eth0 [10.134.0.11/23] from ovn-kubernetes
00:27:31	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-6489d8bf89-cnzm7	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f12dac749638e61febee2ba08244b0888c63ce2c57ef4f65634d36369a9cd02"
00:27:31	openshift-monitoring	multus	prometheus-operator-admission-webhook-6489d8bf89-cnzm7	AddedInterface	Add eth0 [10.134.0.10/23] from ovn-kubernetes
00:27:31	openshift-console	multus	console-64c74c7ff7-k7869	AddedInterface	Add eth0 [10.134.0.12/23] from ovn-kubernetes
00:27:31	openshift-console	kubelet	console-64c74c7ff7-k7869	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0471aac8dca7b920d98cf2b50bdb113f4498c563f3fd9d0a7c76f8bc04a0bd3"
00:27:31	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorVersionChanged	clusteroperator/service-ca version "operator" changed from "" to "4.22.20"
00:27:31	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: status.versions changed from [] to [{"operator" "4.22.20"}]
00:27:31	openshift-image-registry	kubelet	image-registry-d98c5d7fb-9p5s7	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c" already present on machine and can be accessed by the pod
00:27:33	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-6489d8bf89-cnzm7	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f12dac749638e61febee2ba08244b0888c63ce2c57ef4f65634d36369a9cd02" in 2.591s (2.591s including waiting). Image size: 239355688 bytes.
00:27:34	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-6489d8bf89-cnzm7	Created	Container created
00:27:34	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-6489d8bf89-cnzm7	Started	Container started
00:27:35	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/prometheus-operator -n openshift-monitoring because it was missing
00:27:35	openshift-console	kubelet	console-64c74c7ff7-k7869	Started	Container started
00:27:35	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationCreated	Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/alertmanagerconfigs.openshift.io because it was missing
00:27:35	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationCreated	Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/prometheusrules.openshift.io because it was missing
00:27:35	openshift-monitoring	deployment-controller	prometheus-operator	ScalingReplicaSet	Scaled up replica set prometheus-operator-9cd89b74c from 0 to 1
00:27:35	openshift-monitoring	replicaset-controller	prometheus-operator-9cd89b74c	SuccessfulCreate	Created pod: prometheus-operator-9cd89b74c-zw4f5
00:27:35	openshift-console	kubelet	console-64c74c7ff7-k7869	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0471aac8dca7b920d98cf2b50bdb113f4498c563f3fd9d0a7c76f8bc04a0bd3" in 3.471s (3.471s including waiting). Image size: 418098834 bytes.
00:27:35	openshift-console	kubelet	console-64c74c7ff7-k7869	Created	Container created
00:27:36	openshift-monitoring	multus	prometheus-operator-9cd89b74c-zw4f5	AddedInterface	Add eth0 [10.133.0.12/23] from ovn-kubernetes
00:27:36	openshift-monitoring	kubelet	prometheus-operator-9cd89b74c-zw4f5	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b499b2f98a90af17ec927c3bb3283cc21e9fb0b9613ab61e4976ce9415a039c3"
00:27:38	openshift-monitoring	kubelet	prometheus-operator-9cd89b74c-zw4f5	Created	Container created
00:27:38	openshift-monitoring	kubelet	prometheus-operator-9cd89b74c-zw4f5	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:38	openshift-monitoring	kubelet	prometheus-operator-9cd89b74c-zw4f5	Started	Container started
00:27:38	openshift-monitoring	kubelet	prometheus-operator-9cd89b74c-zw4f5	Started	Container started
00:27:38	openshift-monitoring	kubelet	prometheus-operator-9cd89b74c-zw4f5	Created	Container created
00:27:38	openshift-monitoring	kubelet	prometheus-operator-9cd89b74c-zw4f5	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b499b2f98a90af17ec927c3bb3283cc21e9fb0b9613ab61e4976ce9415a039c3" in 2.213s (2.213s including waiting). Image size: 265278346 bytes.
00:27:40	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:27:40	openshift-image-registry	kubelet	image-registry-dfd9f5756-s9tvc	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: {"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/telemeter-client -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/node-exporter because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/thanos-querier -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/node-exporter -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/openshift-state-metrics -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/kube-state-metrics -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/monitoring-rules-edit because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/monitoring-plugin -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/kube-state-metrics -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/thanos-querier -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/alertmanager -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/prometheus -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/openshift-state-metrics -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/metrics-server -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/monitoring-rules-view because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/telemeter-client because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/metrics-server -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/openshift-state-metrics because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/kube-state-metrics because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/kubelet-serving-ca-bundle -n openshift-monitoring because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/node-exporter because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/alert-routing-edit because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/openshift-state-metrics because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/prometheus-k8s because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/kube-state-metrics because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/telemeter-client because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/monitoring-edit because it was missing
00:27:42	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/prometheus-k8s because it was missing
00:27:42 (x2)	openshift-console-operator	console-operator-console-downloads-deployment-controller-consoledownloadsdeploymentsynccontroller	console-operator	DeploymentUpdated	Updated Deployment.apps/downloads -n openshift-console because it changed
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/kube-state-metrics -n openshift-monitoring because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-api-reader -n openshift-user-workload-monitoring because it was missing
00:27:43	openshift-monitoring	kubelet	node-exporter-7k7nh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55"
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/pod-metrics-reader because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/metrics-server-auth-reader -n kube-system because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/user-workload-monitoring-config-edit -n openshift-user-workload-monitoring because it was missing
00:27:43	openshift-monitoring	kubelet	node-exporter-865h2	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55"
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/metrics-server -n openshift-monitoring because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/metrics-server:system:auth-delegator because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/system:aggregated-metrics-reader because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/node-exporter-accelerators-collector-config -n openshift-monitoring because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/system:metrics-server because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/kube-state-metrics-custom-resource-state-configmap -n openshift-monitoring because it was missing
00:27:43	openshift-monitoring	deployment-controller	openshift-state-metrics	ScalingReplicaSet	Scaled up replica set openshift-state-metrics-7bd7489957 from 0 to 1
00:27:43	openshift-monitoring	replicaset-controller	openshift-state-metrics-7bd7489957	SuccessfulCreate	Created pod: openshift-state-metrics-7bd7489957-jnhj4
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/node-exporter -n openshift-monitoring because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-api-writer -n openshift-user-workload-monitoring because it was missing
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/cluster-monitoring-view because it was missing
00:27:43	openshift-monitoring	kubelet	node-exporter-qxqvx	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55"
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/system:metrics-server because it was missing
00:27:43	openshift-monitoring	multus	kube-state-metrics-5dc8d7d89b-m4669	AddedInterface	Add eth0 [10.134.0.15/23] from ovn-kubernetes
00:27:43	openshift-monitoring	deployment-controller	kube-state-metrics	ScalingReplicaSet	Scaled up replica set kube-state-metrics-5dc8d7d89b from 0 to 1
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/openshift-state-metrics -n openshift-monitoring because it was missing
00:27:43	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-59b5cfdfbd from 0 to 1
00:27:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreateFailed	Failed to create ClusterRoleBinding.rbac.authorization.k8s.io/telemeter-client-view: clusterrolebindings.rbac.authorization.k8s.io "cluster-monitoring-view" not found
00:27:43	openshift-monitoring	replicaset-controller	kube-state-metrics-5dc8d7d89b	SuccessfulCreate	Created pod: kube-state-metrics-5dc8d7d89b-m4669
00:27:43	openshift-monitoring	multus	openshift-state-metrics-7bd7489957-jnhj4	AddedInterface	Add eth0 [10.134.0.14/23] from ovn-kubernetes
00:27:43	openshift-console	replicaset-controller	console-59b5cfdfbd	SuccessfulCreate	Created pod: console-59b5cfdfbd-f2rx8
00:27:43	openshift-monitoring	daemonset-controller	node-exporter	SuccessfulCreate	Created pod: node-exporter-7k7nh
00:27:43	openshift-monitoring	daemonset-controller	node-exporter	SuccessfulCreate	Created pod: node-exporter-865h2
00:27:43	openshift-monitoring	daemonset-controller	node-exporter	SuccessfulCreate	Created pod: node-exporter-qxqvx
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/alertmanager-main -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Started	Container started
00:27:44	openshift-console	multus	console-59b5cfdfbd-f2rx8	AddedInterface	Add eth0 [10.134.0.13/23] from ovn-kubernetes
00:27:44	openshift-console	kubelet	console-59b5cfdfbd-f2rx8	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0471aac8dca7b920d98cf2b50bdb113f4498c563f3fd9d0a7c76f8bc04a0bd3" already present on machine and can be accessed by the pod
00:27:44	openshift-console	kubelet	console-59b5cfdfbd-f2rx8	Created	Container created
00:27:44	openshift-console	kubelet	console-59b5cfdfbd-f2rx8	Started	Container started
00:27:44	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:44	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Created	Container created
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/alertmanager-main -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/alertmanager-trusted-ca-bundle -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Started	Container started
00:27:44	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:44	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "OAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.5ce226450bd4aaa499fe.prod.konflux-ocp-ci.dev in route console in namespace openshift-console\nRouteHealthDegraded: route.route.openshift.io \"console\" not found" to "OAuthClientsControllerDegraded: Operation cannot be fulfilled on consoles.operator.openshift.io \"cluster\": the object has been modified; please apply your changes to the latest version and try again\nRouteHealthDegraded: route.route.openshift.io \"console\" not found"
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-edit -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/alertmanager-main because it was missing
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/thanos-querier-kube-rbac-proxy-web -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-view -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/thanos-querier -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/alertmanager-main because it was missing
00:27:44	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Created	Container created
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/cluster-monitoring-metrics-api -n openshift-monitoring because it was missing
00:27:44	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9874a93fcb7ba0d4904d40f6c5989fca3068e2876c06e6640bfe0f2260e97cdd"
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/thanos-querier because it was missing
00:27:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/thanos-querier because it was missing
00:27:44	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5d36eb5ef446f544d30e40642244c16e95cb71c90e18214c951bd84aceecd754"
00:27:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/prometheus-k8s-kube-rbac-proxy-web -n openshift-monitoring because it was missing
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Started	Container started
00:27:45	openshift-monitoring	kubelet	node-exporter-qxqvx	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55" in 2.038s (2.038s including waiting). Image size: 239980401 bytes.
00:27:45	openshift-monitoring	deployment-controller	thanos-querier	ScalingReplicaSet	Scaled up replica set thanos-querier-5dbf58b5cd from 0 to 1
00:27:45	openshift-monitoring	kubelet	node-exporter-qxqvx	Started	Container started
00:27:45	openshift-monitoring	replicaset-controller	thanos-querier-5dbf58b5cd	SuccessfulCreate	Created pod: thanos-querier-5dbf58b5cd-c6sjm
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Created	Container created
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Started	Container started
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Started	Container started
00:27:45	openshift-monitoring	kubelet	node-exporter-865h2	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55" in 1.816s (1.816s including waiting). Image size: 239980401 bytes.
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Created	Container created
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55" already present on machine and can be accessed by the pod
00:27:45	openshift-monitoring	kubelet	node-exporter-qxqvx	Created	Container created
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Created	Container created
00:27:45	openshift-monitoring	kubelet	node-exporter-7k7nh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55" in 1.423s (1.423s including waiting). Image size: 239980401 bytes.
00:27:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/grpc-tls -n openshift-monitoring because it was missing
00:27:45	openshift-monitoring	kubelet	node-exporter-865h2	Created	Container created
00:27:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/prometheus-k8s-config -n openshift-monitoring because it was missing
00:27:45	openshift-monitoring	kubelet	node-exporter-865h2	Started	Container started
00:27:45 (x2)	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	ProbeError	Liveness probe error: HTTP probe failed with statuscode: 503 body: {"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
00:27:45 (x2)	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	Unhealthy	Liveness probe failed: HTTP probe failed with statuscode: 503
00:27:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/prometheus-k8s -n openshift-monitoring because it was missing
00:27:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/alertmanager-prometheusk8s -n openshift-monitoring because it was missing
00:27:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/thanos-querier-grpc-tls-2jdi306t103av -n openshift-monitoring because it was missing
00:27:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/kube-rbac-proxy -n openshift-monitoring because it was missing
00:27:46	openshift-monitoring	kubelet	node-exporter-865h2	Started	Container started
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Created	Container created
00:27:46	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/prometheus-k8s -n default because it was missing
00:27:46	openshift-monitoring	kubelet	node-exporter-qxqvx	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:46	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Started	Container started
00:27:46	openshift-monitoring	kubelet	node-exporter-qxqvx	Started	Container started
00:27:46	openshift-monitoring	kubelet	node-exporter-865h2	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55" already present on machine and can be accessed by the pod
00:27:46	openshift-monitoring	kubelet	node-exporter-qxqvx	Created	Container created
00:27:46	openshift-monitoring	kubelet	node-exporter-qxqvx	Started	Container started
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9874a93fcb7ba0d4904d40f6c5989fca3068e2876c06e6640bfe0f2260e97cdd" in 2.16s (2.16s including waiting). Image size: 260708617 bytes.
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Created	Container created
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Started	Container started
00:27:46	openshift-monitoring	kubelet	node-exporter-865h2	Created	Container created
00:27:46	openshift-monitoring	kubelet	node-exporter-865h2	Started	Container started
00:27:46	openshift-monitoring	kubelet	alertmanager-main-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25"
00:27:46	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Created	Container created
00:27:46	openshift-monitoring	kubelet	node-exporter-865h2	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:46	openshift-monitoring	kubelet	openshift-state-metrics-7bd7489957-jnhj4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5d36eb5ef446f544d30e40642244c16e95cb71c90e18214c951bd84aceecd754" in 1.793s (1.793s including waiting). Image size: 235005105 bytes.
00:27:46	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ad0cd027e6399ec43ef42a80b25d1b88bd4755b9045ed87549fbefbe7b12921c"
00:27:46	openshift-monitoring	multus	thanos-querier-5dbf58b5cd-c6sjm	AddedInterface	Add eth0 [10.134.0.17/23] from ovn-kubernetes
00:27:46	openshift-monitoring	kubelet	node-exporter-865h2	Created	Container created
00:27:46	openshift-monitoring	kubelet	node-exporter-qxqvx	Created	Container created
00:27:46	openshift-monitoring	kubelet	node-exporter-qxqvx	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:306c825877da3a46a906c41411295bf0eb6c6ef9f14dfcb946fc0fda5725de55" already present on machine and can be accessed by the pod
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Created	Container created
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Started	Container started
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:46	openshift-monitoring	multus	alertmanager-main-0	AddedInterface	Add eth0 [10.134.0.16/23] from ovn-kubernetes
00:27:46	openshift-monitoring	kubelet	kube-state-metrics-5dc8d7d89b-m4669	Started	Container started
00:27:47	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: status.relatedObjects changed from [{"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}] to [{"console.openshift.io" "consoleplugins" "" "monitoring-plugin"} {"" "namespaces" "" "openshift-monitoring"} {"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}]
00:27:47 (x2)	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:27:47	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/prometheus-k8s-thanos-sidecar -n openshift-monitoring because it was missing
00:27:47 (x2)	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: {"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
00:27:48	openshift-monitoring	replicaset-controller	monitoring-plugin-77f4f76594	SuccessfulCreate	Created pod: monitoring-plugin-77f4f76594-dbkds
00:27:48	openshift-monitoring	deployment-controller	monitoring-plugin	ScalingReplicaSet	Scaled up replica set monitoring-plugin-77f4f76594 from 0 to 1
00:27:48	openshift-monitoring	kubelet	monitoring-plugin-77f4f76594-dbkds	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9edc1521cd4a995763f36869e145d291b99c9c307f53f78959d9a5f1a0553c21"
00:27:48	openshift-monitoring	replicaset-controller	metrics-server-547554f588	SuccessfulCreate	Created pod: metrics-server-547554f588-2ksph
00:27:48	openshift-monitoring	deployment-controller	metrics-server	ScalingReplicaSet	Scaled up replica set metrics-server-547554f588 from 0 to 1
00:27:48	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" in 2.405s (2.405s including waiting). Image size: 238574368 bytes.
00:27:48	openshift-monitoring	multus	monitoring-plugin-77f4f76594-dbkds	AddedInterface	Add eth0 [10.133.0.13/23] from ovn-kubernetes
00:27:48	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:27:48	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:27:49	openshift-monitoring	kubelet	metrics-server-547554f588-2ksph	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9fd41846039a84fc73911fad82599c3bf0da739a48bd5f898d863e36f58ca54a"
00:27:49	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "OAuthClientsControllerDegraded: Operation cannot be fulfilled on consoles.operator.openshift.io \"cluster\": the object has been modified; please apply your changes to the latest version and try again\nRouteHealthDegraded: route.route.openshift.io \"console\" not found" to "RouteHealthDegraded: route.route.openshift.io \"console\" not found"
00:27:49	openshift-monitoring	multus	metrics-server-547554f588-2ksph	AddedInterface	Add eth0 [10.134.0.18/23] from ovn-kubernetes
00:27:49	openshift-monitoring	kubelet	alertmanager-main-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de5f95977e32d65d7f0586eb297cd098da0acaaffb3512483d50bd6eda40bfb8"
00:27:49	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ad0cd027e6399ec43ef42a80b25d1b88bd4755b9045ed87549fbefbe7b12921c" in 3.157s (3.157s including waiting). Image size: 332950491 bytes.
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Started	Container started
00:27:50	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/prometheus-k8s-grpc-tls-ca7m2fud26mcu -n openshift-monitoring because it was missing
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Created	Container created
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Created	Container created
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Started	Container started
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b082e4f342a6414db34822eba4d3cbdd716cdc60b8b2ba36ea87a1b52dc5a5ed"
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Created	Container created
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:50	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Started	Container started
00:27:51	openshift-monitoring	kubelet	monitoring-plugin-77f4f76594-dbkds	Created	Container created
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Created	Container created
00:27:51	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/prometheus-k8s-additional-alertmanager-configs -n openshift-monitoring because it was missing
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Created	Container created
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Started	Container started
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Started	Container started
00:27:51	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/prometheus-trusted-ca-bundle -n openshift-monitoring because it was missing
00:27:51	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-59b5cfdfbd from 1 to 0
00:27:51	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-6dcc4446d8 from 0 to 1
00:27:51	openshift-console	replicaset-controller	console-6dcc4446d8	SuccessfulCreate	Created pod: console-6dcc4446d8-gnncq
00:27:51	openshift-monitoring	kubelet	metrics-server-547554f588-2ksph	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9fd41846039a84fc73911fad82599c3bf0da739a48bd5f898d863e36f58ca54a" in 2.287s (2.287s including waiting). Image size: 280125410 bytes.
00:27:51	openshift-console	replicaset-controller	console-59b5cfdfbd	SuccessfulDelete	Deleted pod: console-59b5cfdfbd-f2rx8
00:27:51	openshift-monitoring	kubelet	metrics-server-547554f588-2ksph	Created	Container created
00:27:51	openshift-console	kubelet	console-59b5cfdfbd-f2rx8	Killing	Stopping container console
00:27:51	openshift-monitoring	kubelet	metrics-server-547554f588-2ksph	Started	Container started
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:51	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: route.route.openshift.io \"console\" not found" to "All is well",Available changed from Unknown to True ("All is well")
00:27:51	openshift-monitoring	kubelet	monitoring-plugin-77f4f76594-dbkds	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9edc1521cd4a995763f36869e145d291b99c9c307f53f78959d9a5f1a0553c21" in 2.261s (2.261s including waiting). Image size: 264439625 bytes.
00:27:51	openshift-monitoring	kubelet	monitoring-plugin-77f4f76594-dbkds	Started	Container started
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b082e4f342a6414db34822eba4d3cbdd716cdc60b8b2ba36ea87a1b52dc5a5ed" in 1.339s (1.339s including waiting). Image size: 216697117 bytes.
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Created	Container created
00:27:51	openshift-monitoring	kubelet	thanos-querier-5dbf58b5cd-c6sjm	Started	Container started
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de5f95977e32d65d7f0586eb297cd098da0acaaffb3512483d50bd6eda40bfb8" in 2.691s (2.691s including waiting). Image size: 276699143 bytes.
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:27:52	openshift-console	multus	console-6dcc4446d8-gnncq	AddedInterface	Add eth0 [10.134.0.19/23] from ovn-kubernetes
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" already present on machine and can be accessed by the pod
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b082e4f342a6414db34822eba4d3cbdd716cdc60b8b2ba36ea87a1b52dc5a5ed" already present on machine and can be accessed by the pod
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:27:52	openshift-console	kubelet	console-6dcc4446d8-gnncq	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0471aac8dca7b920d98cf2b50bdb113f4498c563f3fd9d0a7c76f8bc04a0bd3" already present on machine and can be accessed by the pod
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:27:52	openshift-console	kubelet	console-6dcc4446d8-gnncq	Created	Container created
00:27:52	openshift-console	kubelet	console-6dcc4446d8-gnncq	Started	Container started
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:27:52	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:27:53	openshift-image-registry	replicaset-controller	image-registry-6c9bd86665	SuccessfulDelete	Deleted pod: image-registry-6c9bd86665-k87ds
00:27:53	openshift-image-registry	kubelet	image-registry-6c9bd86665-k87ds	Killing	Stopping container registry
00:27:53	openshift-monitoring	multus	prometheus-k8s-0	AddedInterface	Add eth0 [10.133.0.14/23] from ovn-kubernetes
00:27:53	openshift-monitoring	kubelet	prometheus-k8s-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25"
00:27:53	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled down replica set image-registry-6c9bd86665 from 1 to 0
00:27:54	openshift-monitoring	kubelet	prometheus-k8s-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d79844b9582c796368e1e2598ccb81542bc3449eb76d4bc3609353cfc44cedca"
00:27:54	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" in 1.415s (1.415s including waiting). Image size: 238574368 bytes.
00:27:54	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:27:54	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:27:55	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing changed from False to True ("SyncLoopRefreshProgressing: deployment generation 3 not yet observed (observed: 2)")
00:27:55	openshift-console	kubelet	downloads-6dd789c8b7-g6lwk	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c3da5821b9e51334e9c523aca7fca6a9ef8b853fd4f238b908b086b129619d" in 23.664s (23.664s including waiting). Image size: 2077352356 bytes.
00:27:55	openshift-console	kubelet	downloads-6dd789c8b7-g6lwk	Created	Container created
00:27:55	openshift-console	kubelet	downloads-6dd789c8b7-g6lwk	Started	Container started
00:27:58	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:27:58	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:27:58	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d79844b9582c796368e1e2598ccb81542bc3449eb76d4bc3609353cfc44cedca" in 3.482s (3.482s including waiting). Image size: 468860379 bytes.
00:27:58	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:27:58	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" already present on machine and can be accessed by the pod
00:27:58	openshift-monitoring	kubelet	prometheus-k8s-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ad0cd027e6399ec43ef42a80b25d1b88bd4755b9045ed87549fbefbe7b12921c"
00:27:58	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ad0cd027e6399ec43ef42a80b25d1b88bd4755b9045ed87549fbefbe7b12921c" in 3.3s (3.3s including waiting). Image size: 332950491 bytes.
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:28:01	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:28:02	openshift-console	replicaset-controller	console-64c74c7ff7	SuccessfulDelete	Deleted pod: console-64c74c7ff7-k7869
00:28:02	openshift-console	kubelet	console-64c74c7ff7-k7869	Killing	Stopping container console
00:28:02	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-64c74c7ff7 from 1 to 0
00:28:21	openshift-service-ca-operator	kubelet	service-ca-operator-544d749c8c-bkjl8	Started	Container started
00:28:21	openshift-service-ca-operator	kubelet	service-ca-operator-544d749c8c-bkjl8	Created	Container created
00:28:21	openshift-service-ca-operator	kubelet	service-ca-operator-544d749c8c-bkjl8	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9cb8e7495661fc6305dc7c76cb7758febf03346c441c2bb87f31f1c3f478b693" already present on machine and can be accessed by the pod
00:28:22	openshift-service-ca-operator	service-ca-operator	service-ca-operator-lock	LeaderElection	service-ca-operator-544d749c8c-bkjl8_dedee0b4-e02c-4551-a747-f615290b9d9d became leader
00:28:22	openshift-service-ca-operator	service-ca-operator	service-ca-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:28:29	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	APIServiceCreated	Created APIService.apiregistration.k8s.io/v1beta1.metrics.k8s.io because it was missing
00:28:35	openshift-insights	kubelet	insights-operator-7c4986d449-8x7tk	Started	Container started
00:28:35	openshift-insights	kubelet	insights-operator-7c4986d449-8x7tk	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4f6a06f8fd2e41c1080f083d1fd9114deee35547a92f4e3cf5bdaf6d1a72aa7" already present on machine and can be accessed by the pod
00:28:35	openshift-insights	kubelet	insights-operator-7c4986d449-8x7tk	Created	Container created
00:28:36	openshift-insights	kubelet	periodic-gathering-894dj-29wl8	Killing	Stopping container insights-gathering
00:28:36	openshift-insights	openshift-insights-operator	insights-operator	DaemonSet Updated	Runtime extractor DaemonSet openshift-insights/insights-runtime-extractor was created or updated
00:28:36	openshift-insights	openshift-insights-operator	insights-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AzureClusterHostedDNSInstall", "AzureWorkloadIdentity", "BootImageSkewEnforcement", "BuildCSIVolumes", "ConsolePluginContentSecurityPolicy", "DualReplica", "EVPN", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPSovereignCloudInstall", "GatewayAPIWithoutOLM", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "KMSv1", "ManagedBootImagesCPMS", "MetricsCollectionProfiles", "MutableCSINodeAllocatableCount", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSEuropeanSovereignCloudInstall", "AWSServiceLBNetworkSecurityGroup", "AdditionalStorageConfig", "AutomatedEtcdBackup", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "CRIOCredentialProviderConfig", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIComputeInstall", "ClusterAPIControlPlaneInstall", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementAWS", "ClusterAPIMachineManagementAzure", "ClusterAPIMachineManagementBareMetal", "ClusterAPIMachineManagementGCP", "ClusterAPIMachineManagementOpenStack", "ClusterAPIMachineManagementPowerVS", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterUpdateAcceptRisks", "ClusterUpdatePreflight", "ClusterVersionOperatorConfiguration", "ConfidentialCluster", "ConfigurablePKI", "DNSNameResolver", "DRAPartitionableDevices", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCExternalClaimsSourcing", "ExternalOIDCWithUpstreamParity", "ExternalSnapshotMetadata", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIMigrationAWS", "MachineAPIMigrationOpenStack", "MachineAPIMigrationVSphere", "MachineAPIOperatorDisableMachineHealthCheckController", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NetworkConnect", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMConfigAPI", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoOverlayMode", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TLSAdherence", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereMultiVCenterDay2", "VolumeGroupSnapshot"}}
00:28:36	openshift-insights	openshift-insights-operator	insights-operator	DaemonSetUpdated	Updated DaemonSet.apps/insights-runtime-extractor -n openshift-insights because it changed
00:28:40	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Started	Container started
00:28:40	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6adea7dd46814e9cda452b4db098f13c5ab6c9eb0f5671ddb1154ef49c36ec5d" already present on machine and can be accessed by the pod
00:28:40	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	Created	Container created
00:28:41	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-lock	LeaderElection	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24_c3ec69f0-faf4-49df-bcb4-7b9b13608df7 became leader
00:28:53	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationUpdated	Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/alertmanagerconfigs.openshift.io because it changed
00:28:53	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationUpdated	Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/prometheusrules.openshift.io because it changed
00:28:57	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/telemeter-client -n openshift-monitoring because it was missing
00:28:57	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/telemeter-client-kube-rbac-proxy-config -n openshift-monitoring because it was missing
00:28:57	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/telemeter-client -n openshift-monitoring because it was missing
00:28:57	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/telemeter-client-view because it was missing
00:28:59	openshift-monitoring	kubelet	alertmanager-main-0	Killing	Stopping container kube-rbac-proxy-metric
00:28:59	openshift-monitoring	statefulset-controller	alertmanager-main	SuccessfulDelete	Delete Pod alertmanager-main-0 in StatefulSet alertmanager-main successful
00:28:59	openshift-monitoring	kubelet	alertmanager-main-0	Killing	Stopping container alertmanager
00:29:01	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:29:01	openshift-monitoring	multus	alertmanager-main-0	AddedInterface	Add eth0 [10.134.0.20/23] from ovn-kubernetes
00:29:01	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" already present on machine and can be accessed by the pod
00:29:01	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:29:01 (x2)	openshift-monitoring	statefulset-controller	alertmanager-main	SuccessfulCreate	Create Pod alertmanager-main-0 in StatefulSet alertmanager-main successful
00:29:02	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:29:02	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de5f95977e32d65d7f0586eb297cd098da0acaaffb3512483d50bd6eda40bfb8" already present on machine and can be accessed by the pod
00:29:02	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:29:02	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/telemeter-trusted-ca-bundle-28r105lbnph2c -n openshift-monitoring because it was missing
00:29:02	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" already present on machine and can be accessed by the pod
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b082e4f342a6414db34822eba4d3cbdd716cdc60b8b2ba36ea87a1b52dc5a5ed" already present on machine and can be accessed by the pod
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Started	Container started
00:29:03	openshift-monitoring	kubelet	alertmanager-main-0	Created	Container created
00:29:03	openshift-monitoring	multus	telemeter-client-5d5dd7655d-nknlw	AddedInterface	Add eth0 [10.134.0.21/23] from ovn-kubernetes
00:29:03	openshift-monitoring	deployment-controller	telemeter-client	ScalingReplicaSet	Scaled up replica set telemeter-client-5d5dd7655d from 0 to 1
00:29:03	openshift-monitoring	replicaset-controller	telemeter-client-5d5dd7655d	SuccessfulCreate	Created pod: telemeter-client-5d5dd7655d-nknlw
00:29:03	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0651de544fdcb2aafecd6448eeb1d6bc2e08afa2b6d87c36719455856498b0bc"
00:29:05	openshift-monitoring	kubelet	prometheus-k8s-0	Killing	Stopping container prometheus
00:29:05	openshift-monitoring	statefulset-controller	prometheus-k8s	SuccessfulDelete	Delete Pod prometheus-k8s-0 in StatefulSet prometheus-k8s successful
00:29:06	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" already present on machine and can be accessed by the pod
00:29:06	openshift-monitoring	multus	prometheus-k8s-0	AddedInterface	Add eth0 [10.133.0.15/23] from ovn-kubernetes
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Started	Container started
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Created	Container created
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Started	Container started
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Created	Container created
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" already present on machine and can be accessed by the pod
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Started	Container started
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Created	Container created
00:29:06	openshift-monitoring	kubelet	telemeter-client-5d5dd7655d-nknlw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0651de544fdcb2aafecd6448eeb1d6bc2e08afa2b6d87c36719455856498b0bc" in 2.796s (2.796s including waiting). Image size: 293363226 bytes.
00:29:07	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:29:07	openshift-console	replicaset-controller	console-77cb9c864f	SuccessfulCreate	Created pod: console-77cb9c864f-7k75w
00:29:07	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/telemeter-client -n openshift-monitoring because it was missing
00:29:07	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing changed from False to True ("SyncLoopRefreshProgressing: deployment generation 4 not yet observed (observed: 3)")
00:29:07	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d79844b9582c796368e1e2598ccb81542bc3449eb76d4bc3609353cfc44cedca" already present on machine and can be accessed by the pod
00:29:07	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:29:07	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-77cb9c864f from 0 to 1
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:29:08	openshift-console	kubelet	console-77cb9c864f-7k75w	Started	Container started
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:29:08	openshift-console	kubelet	console-77cb9c864f-7k75w	Created	Container created
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:29:08	openshift-console	multus	console-77cb9c864f-7k75w	AddedInterface	Add eth0 [10.134.0.22/23] from ovn-kubernetes
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:29:08	openshift-console	kubelet	console-77cb9c864f-7k75w	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0471aac8dca7b920d98cf2b50bdb113f4498c563f3fd9d0a7c76f8bc04a0bd3" already present on machine and can be accessed by the pod
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51" already present on machine and can be accessed by the pod
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ad0cd027e6399ec43ef42a80b25d1b88bd4755b9045ed87549fbefbe7b12921c" already present on machine and can be accessed by the pod
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Container started
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e486ce14030d80080e03c54808e12e10296842311fb3221cd3181259f5a09f25" already present on machine and can be accessed by the pod
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:29:08	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Container created
00:29:18	openshift-console	replicaset-controller	console-6dcc4446d8	SuccessfulDelete	Deleted pod: console-6dcc4446d8-gnncq
00:29:18	openshift-console	kubelet	console-6dcc4446d8-gnncq	Killing	Stopping container console
00:29:18	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-6dcc4446d8 from 1 to 0
00:30:14	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	NetworkPolicyCreated	Created NetworkPolicy.networking.k8s.io/deny-cluster-monitoring-operator-and-operands -n openshift-monitoring because it was missing
00:30:14	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/monitoring-shared-config -n openshift-config-managed because it was missing
00:30:22 (x3)	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	ConfigMapUpdated	Updated ConfigMap/console-config -n openshift-console: cause by changes in data.console-config.yaml
00:30:23	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-79f9c6b794 from 0 to 1
00:30:23	openshift-console	multus	console-79f9c6b794-jzhvk	AddedInterface	Add eth0 [10.134.0.23/23] from ovn-kubernetes
00:30:23	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing changed from False to True ("SyncLoopRefreshProgressing: deployment generation 5 not yet observed (observed: 4)")
00:30:23	openshift-console	kubelet	console-79f9c6b794-jzhvk	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0471aac8dca7b920d98cf2b50bdb113f4498c563f3fd9d0a7c76f8bc04a0bd3" already present on machine and can be accessed by the pod
00:30:23	openshift-console	kubelet	console-79f9c6b794-jzhvk	Created	Container created
00:30:23	openshift-console	kubelet	console-79f9c6b794-jzhvk	Started	Container started
00:30:23	openshift-console	replicaset-controller	console-79f9c6b794	SuccessfulCreate	Created pod: console-79f9c6b794-jzhvk
00:30:24 (x7)	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	DeploymentUpdated	Updated Deployment.apps/console -n openshift-console because it changed
00:30:24 (x3)	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing changed from True to False ("All is well")
00:30:34	openshift-console	replicaset-controller	console-77cb9c864f	SuccessfulDelete	Deleted pod: console-77cb9c864f-7k75w
00:30:34	openshift-console	kubelet	console-77cb9c864f-7k75w	Killing	Stopping container console
00:30:34	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-77cb9c864f from 1 to 0
00:32:40	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for rhoai-deps namespace
00:32:40	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kuadrant-system namespace
00:32:40	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for cert-manager-operator namespace
00:32:41	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
00:32:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-jobset-operator namespace
00:32:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for opendatahub-operator-system namespace
00:32:42	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7876bfcb74	SuccessfulCreate	Created pod: istiod-openshift-gateway-7876bfcb74-ssc2x
00:32:42	openshift-ingress	multus	istiod-openshift-gateway-7876bfcb74-ssc2x	AddedInterface	Add eth0 [10.134.0.25/23] from ovn-kubernetes
00:32:42	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1
00:32:43	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
00:32:46	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	Created	Container created
00:32:46	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.784s (3.784s including waiting). Image size: 185476477 bytes.
00:32:46	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	Started	Container started
00:32:48 (x2)	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:32:48 (x2)	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:32:49	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-gbc5r
00:32:49	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 0 to 1
00:32:49	openshift-ingress	service-controller	openshift-ai-inference-openshift-ai-inference	EnsuringLoadBalancer	Ensuring load balancer
00:32:49	openshift-ingress	deployment-controller	openshift-ai-inference-openshift-ai-inference	ScalingReplicaSet	Scaled up replica set openshift-ai-inference-openshift-ai-inference-597546666c from 0 to 1
00:32:49	openshift-ingress	replicaset-controller	openshift-ai-inference-openshift-ai-inference-597546666c	SuccessfulCreate	Created pod: openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt
00:32:50	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
00:32:50	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
00:32:50	openshift-ingress	multus	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	AddedInterface	Add eth0 [10.132.0.34/23] from ovn-kubernetes
00:32:50	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	AddedInterface	Add eth0 [10.132.0.33/23] from ovn-kubernetes
00:32:53	openshift-ingress	service-controller	openshift-ai-inference-openshift-ai-inference	EnsuredLoadBalancer	Ensured load balancer
00:32:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.552s (8.552s including waiting). Image size: 183555333 bytes.
00:32:59	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	Created	Container created
00:32:59	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	Started	Container started
00:32:59	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.178s (9.178s including waiting). Image size: 183555333 bytes.
00:33:00	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	Unhealthy	Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
00:33:00	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	ProbeError	Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:
00:33:15 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	RequirementsUnknown	requirements not yet checked
00:33:15 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	RequirementsNotMet	one or more requirements couldn't be found
00:33:16	opendatahub-operator-system	deployment-controller	opendatahub-operator-controller-manager	ScalingReplicaSet	Scaled up replica set opendatahub-operator-controller-manager-6b5d59bb59 from 0 to 3
00:33:16	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-6b5d59bb59	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-6b5d59bb59-n8ht5
00:33:16	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-6b5d59bb59	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-6b5d59bb59-n2w5c
00:33:16	opendatahub-operator-system	multus	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	AddedInterface	Add eth0 [10.132.0.35/23] from ovn-kubernetes
00:33:16	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-6b5d59bb59	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-6b5d59bb59-khdbh
00:33:17	opendatahub-operator-system	multus	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	AddedInterface	Add eth0 [10.133.0.16/23] from ovn-kubernetes
00:33:17	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:33:17	opendatahub-operator-system	multus	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	AddedInterface	Add eth0 [10.134.0.26/23] from ovn-kubernetes
00:33:17	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:33:17	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.372s (3.372s including waiting). Image size: 273709574 bytes.
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.197s (3.197s including waiting). Image size: 273709574 bytes.
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Created	Container created
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Started	Container started
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.407s (3.407s including waiting). Image size: 273709574 bytes.
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Created	Container created
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Started	Container started
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Created	Container created
00:33:20	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Started	Container started
00:33:21	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:33:21	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:33:21	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 891ms (891ms including waiting). Image size: 273709574 bytes.
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Created	Container created
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Started	Container started
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 819ms (819ms including waiting). Image size: 273709574 bytes.
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 827ms (827ms including waiting). Image size: 273709574 bytes.
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Created	Container created
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	Started	Container started
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Created	Container created
00:33:22	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	Started	Container started
00:33:23 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	NeedsReinstall	calculated deployment install is bad
00:33:23	opendatahub-operator-system	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c_bde9af42-7fe9-4327-ba61-4dfeb7fc791c	07ed84f7.opendatahub.io	LeaderElection	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c_bde9af42-7fe9-4327-ba61-4dfeb7fc791c became leader
00:33:24 (x2)	opendatahub-operator-system	operator-lifecycle-manager	install-dqwp6	AppliedWithWarnings	1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
00:33:27	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	RequirementsNotMet	one or more requirements couldn't be found
00:33:27	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	RequirementsUnknown	requirements not yet checked
00:33:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for cert-manager namespace
00:33:30	openshift-jobset-operator	deployment-controller	jobset-operator	ScalingReplicaSet	Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
00:33:30	openshift-jobset-operator	replicaset-controller	jobset-operator-674cd59dc5	SuccessfulCreate	Created pod: jobset-operator-674cd59dc5-tn9c7
00:33:30	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-tn9c7	Pulling	Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
00:33:30	openshift-jobset-operator	multus	jobset-operator-674cd59dc5-tn9c7	AddedInterface	Add eth0 [10.132.0.37/23] from ovn-kubernetes
00:33:31	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	RequirementsNotMet	one or more requirements couldn't be found
00:33:31	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	RequirementsUnknown	requirements not yet checked
00:33:34	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	InstallSucceeded	install strategy completed with no errors
00:33:35 (x3)	openshift-ingress	horizontal-pod-autoscaler	openshift-ai-inference-openshift-ai-inference	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:33:35 (x3)	openshift-ingress	horizontal-pod-autoscaler	openshift-ai-inference-openshift-ai-inference	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:33:36	kuadrant-system	replicaset-controller	limitador-operator-controller-manager-5778bb4449	SuccessfulCreate	Created pod: limitador-operator-controller-manager-5778bb4449-7hsnc
00:33:36	kuadrant-system	deployment-controller	limitador-operator-controller-manager	ScalingReplicaSet	Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1
00:33:37	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	RequirementsNotMet	one or more requirements couldn't be found
00:33:37	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	RequirementsUnknown	requirements not yet checked
00:33:37	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-7hsnc	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"
00:33:37	kuadrant-system	multus	limitador-operator-controller-manager-5778bb4449-7hsnc	AddedInterface	Add eth0 [10.132.0.38/23] from ovn-kubernetes
00:33:40	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-tn9c7	Started	Container started
00:33:40	kuadrant-system	replicaset-controller	dns-operator-controller-manager-8557cbdb84	SuccessfulCreate	Created pod: dns-operator-controller-manager-8557cbdb84-9m7mp
00:33:40	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-tn9c7	Created	Container created
00:33:40	kuadrant-system	deployment-controller	dns-operator-controller-manager	ScalingReplicaSet	Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1
00:33:40	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-tn9c7	Pulled	Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 9.897s (9.897s including waiting). Image size: 224874686 bytes.
00:33:40	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	RequirementsUnknown	requirements not yet checked
00:33:40	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	RequirementsNotMet	one or more requirements couldn't be found
00:33:41	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	InstallSucceeded	install strategy completed with no errors
00:33:41	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-7hsnc	Started	Container started
00:33:41	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-7hsnc	Created	Container created
00:33:41	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-7hsnc	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 3.711s (3.711s including waiting). Image size: 177967631 bytes.
00:33:41	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-9m7mp	Pulling	Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"
00:33:41	kuadrant-system	multus	dns-operator-controller-manager-8557cbdb84-9m7mp	AddedInterface	Add eth0 [10.132.0.39/23] from ovn-kubernetes
00:33:41	openshift-jobset-operator	openshift-jobset-operator	openshift-jobset-operator-lock	LeaderElection	jobset-operator-674cd59dc5-tn9c7_64ace7d6-6347-4548-845d-931aecb6d15f became leader
00:33:42	kuadrant-system	limitador-operator-controller-manager-5778bb4449-7hsnc_94387285-027b-4c98-8294-7c85ca99f6a6	3745a16e.kuadrant.io	LeaderElection	limitador-operator-controller-manager-5778bb4449-7hsnc_94387285-027b-4c98-8294-7c85ca99f6a6 became leader
00:33:43	kuadrant-system	replicaset-controller	authorino-operator-7b7bb4bc77	SuccessfulCreate	Created pod: authorino-operator-7b7bb4bc77-zr6mf
00:33:43	kuadrant-system	deployment-controller	authorino-operator	ScalingReplicaSet	Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1
00:33:43	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-9m7mp	Started	Container started
00:33:43	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-9m7mp	Created	Container created
00:33:43	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-9m7mp	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.258s (2.258s including waiting). Image size: 190804149 bytes.
00:33:44	kuadrant-system	multus	authorino-operator-7b7bb4bc77-zr6mf	AddedInterface	Add eth0 [10.132.0.40/23] from ovn-kubernetes
00:33:44	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	RequirementsUnknown	requirements not yet checked
00:33:44	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	RequirementsNotMet	one or more requirements couldn't be found
00:33:44	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-zr6mf	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"
00:33:44	kuadrant-system	dns-operator-controller-manager-8557cbdb84-9m7mp_3e19499b-4f8e-46fb-ad64-0a11116216d1	a3f98d6c.kuadrant.io	LeaderElection	dns-operator-controller-manager-8557cbdb84-9m7mp_3e19499b-4f8e-46fb-ad64-0a11116216d1 became leader
00:33:46	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-zr6mf	Created	Container created
00:33:46	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-zr6mf	Started	Container started
00:33:46	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-zr6mf	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.285s (2.285s including waiting). Image size: 167738465 bytes.
00:33:47	kuadrant-system	authorino-operator-7b7bb4bc77-zr6mf_65977d7b-91ed-471e-965f-6403a30fa68f	aac3a15d.authorino.kuadrant.io	LeaderElection	authorino-operator-7b7bb4bc77-zr6mf_65977d7b-91ed-471e-965f-6403a30fa68f became leader
00:33:49	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-678d87766f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-678d87766f-7kk5k
00:33:50	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-7kk5k	Pulling	Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"
00:33:50	kuadrant-system	multus	kuadrant-operator-controller-manager-678d87766f-7kk5k	AddedInterface	Add eth0 [10.132.0.41/23] from ovn-kubernetes
00:33:53	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallSucceeded	install strategy completed with no errors
00:33:54	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-7kk5k	Created	Container created
00:33:54	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-7kk5k	Started	Container started
00:33:54	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-7kk5k	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.392s (4.392s including waiting). Image size: 424244516 bytes.
00:33:55	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallSucceeded	install strategy completed with no errors
00:33:55	kuadrant-system	kuadrant-operator-controller-manager-678d87766f-7kk5k_6a74e951-caf5-4940-80d9-c1e8edd4362b	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-678d87766f-7kk5k_6a74e951-caf5-4940-80d9-c1e8edd4362b became leader
00:33:57	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing
00:33:57	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing
00:33:57	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ServiceCreated	Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing
00:33:57	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing
00:33:57	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for opendatahub namespace
00:33:57	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing
00:33:57	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ServiceAccountCreated	Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing
00:33:57	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	IssuerCreated	Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing
00:33:58	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing
00:33:58	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	CertificateCreated	Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing
00:33:58	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing
00:33:58	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallSucceeded	install strategy completed with no errors
00:33:58	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	CertificateCreated	Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing
00:33:58	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing
00:33:58	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing
00:33:59	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing
00:33:59	openshift-ingress	replicaset-controller	kube-auth-proxy-5d55d55f6d	SuccessfulCreate	Created pod: kube-auth-proxy-5d55d55f6d-xsfmv
00:33:59	openshift-ingress	replicaset-controller	kube-auth-proxy-5d55d55f6d	SuccessfulCreate	Created pod: kube-auth-proxy-5d55d55f6d-h897p
00:33:59	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-5d55d55f6d from 0 to 2
00:33:59	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ServiceCreated	Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing
00:33:59	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing
00:33:59	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-6bc49dd89 from 0 to 1
00:34:00	openshift-ingress	multus	kube-auth-proxy-5d55d55f6d-h897p	AddedInterface	Add eth0 [10.133.0.20/23] from ovn-kubernetes
00:34:00	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8	Started	Container started
00:34:00	openshift-ingress	multus	kube-auth-proxy-5d55d55f6d-xsfmv	AddedInterface	Add eth0 [10.134.0.27/23] from ovn-kubernetes
00:34:00	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-xsfmv	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"
00:34:00	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8	AddedInterface	Add eth0 [10.132.0.42/23] from ovn-kubernetes
00:34:00	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:34:00	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8	Created	Container created
00:34:00	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-h897p	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"
00:34:00	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-6bc49dd89	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8
00:34:01	kuadrant-system	replicaset-controller	kuadrant-console-plugin-66c4fb575d	SuccessfulCreate	Created pod: kuadrant-console-plugin-66c4fb575d-ngn8q
00:34:01	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1
00:34:01	kuadrant-system	replicaset-controller	limitador-limitador-74dfcfb894	SuccessfulCreate	Created pod: limitador-limitador-74dfcfb894-66m6m
00:34:01	kuadrant-system	deployment-controller	kuadrant-console-plugin	ScalingReplicaSet	Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1
00:34:02	kuadrant-system	multus	kuadrant-console-plugin-66c4fb575d-ngn8q	AddedInterface	Add eth0 [10.133.0.21/23] from ovn-kubernetes
00:34:02	kuadrant-system	multus	limitador-limitador-74dfcfb894-66m6m	AddedInterface	Add eth0 [10.134.0.28/23] from ovn-kubernetes
00:34:02	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-66m6m	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"
00:34:02	kuadrant-system	kubelet	kuadrant-console-plugin-66c4fb575d-ngn8q	Pulling	Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"
00:34:03	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-h897p	Started	Container started
00:34:03	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-xsfmv	Started	Container started
00:34:03	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-h897p	Created	Container created
00:34:03	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-h897p	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.899s (2.899s including waiting). Image size: 188904677 bytes.
00:34:03	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-xsfmv	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.866s (2.866s including waiting). Image size: 188904677 bytes.
00:34:03	openshift-ingress	kubelet	kube-auth-proxy-5d55d55f6d-xsfmv	Created	Container created
00:34:03	kuadrant-system	kubelet	authorino-57f7f8659f-gjz2s	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:34:03	kuadrant-system	replicaset-controller	authorino-57f7f8659f	SuccessfulCreate	Created pod: authorino-57f7f8659f-gjz2s
00:34:03	kuadrant-system	multus	authorino-57f7f8659f-gjz2s	AddedInterface	Add eth0 [10.133.0.22/23] from ovn-kubernetes
00:34:03	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-57f7f8659f from 0 to 1
00:34:04	kuadrant-system	replicaset-controller	authorino-56c6c9ddd5	SuccessfulCreate	Created pod: authorino-56c6c9ddd5-zvqfw
00:34:04	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1
00:34:04	kuadrant-system	replicaset-controller	limitador-limitador-7c9b87d574	SuccessfulCreate	Created pod: limitador-limitador-7c9b87d574-9jgw7
00:34:04	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-56c6c9ddd5 from 0 to 1
00:34:05	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-9jgw7	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"
00:34:05	kuadrant-system	kubelet	authorino-56c6c9ddd5-zvqfw	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:34:05	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-66m6m	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.32s (3.32s including waiting). Image size: 133379307 bytes.
00:34:05	kuadrant-system	multus	authorino-56c6c9ddd5-zvqfw	AddedInterface	Add eth0 [10.132.0.43/23] from ovn-kubernetes
00:34:05	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-66m6m	Created	Container created
00:34:05	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-66m6m	Started	Container started
00:34:05	kuadrant-system	multus	limitador-limitador-7c9b87d574-9jgw7	AddedInterface	Add eth0 [10.133.0.23/23] from ovn-kubernetes
00:34:07	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-9jgw7	Started	Container started
00:34:07	kuadrant-system	kubelet	authorino-57f7f8659f-gjz2s	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.454s (3.454s including waiting). Image size: 204096810 bytes.
00:34:07	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-9jgw7	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.752s (1.752s including waiting). Image size: 133379307 bytes.
00:34:07	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-9jgw7	Created	Container created
00:34:07	kuadrant-system	kubelet	authorino-57f7f8659f-gjz2s	Created	Container created
00:34:07	kuadrant-system	kubelet	authorino-57f7f8659f-gjz2s	Started	Container started
00:34:08	kuadrant-system	replicaset-controller	authorino-57f7f8659f	SuccessfulDelete	Deleted pod: authorino-57f7f8659f-gjz2s
00:34:08	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-57f7f8659f from 1 to 0
00:34:08	kuadrant-system	kubelet	authorino-56c6c9ddd5-zvqfw	Started	Container started
00:34:08	kuadrant-system	kubelet	authorino-56c6c9ddd5-zvqfw	Created	Container created
00:34:08	kuadrant-system	kubelet	authorino-56c6c9ddd5-zvqfw	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.722s (2.722s including waiting). Image size: 204096810 bytes.
00:34:09	kuadrant-system	kubelet	authorino-57f7f8659f-gjz2s	Killing	Stopping container authorino
00:34:11	opendatahub	replicaset-controller	kserve-module-controller-manager-7566cf5fc8	SuccessfulCreate	Created pod: kserve-module-controller-manager-7566cf5fc8-s59js
00:34:11	opendatahub	deployment-controller	kserve-module-controller-manager	ScalingReplicaSet	Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1
00:34:12	kuadrant-system	kubelet	kuadrant-console-plugin-66c4fb575d-ngn8q	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 9.653s (9.653s including waiting). Image size: 342538866 bytes.
00:34:12	kuadrant-system	kubelet	kuadrant-console-plugin-66c4fb575d-ngn8q	Started	Container started
00:34:12	opendatahub	multus	kserve-module-controller-manager-7566cf5fc8-s59js	AddedInterface	Add eth0 [10.132.0.44/23] from ovn-kubernetes
00:34:12	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-s59js	Pulling	Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"
00:34:12	openshift-jobset-operator	cert-manager-certificates-trigger	jobset-serving-cert	Issuing	Issuing certificate as Secret does not exist
00:34:12	openshift-jobset-operator	cert-manager-certificates-trigger	jobset-metrics-cert	Issuing	Issuing certificate as Secret does not exist
00:34:12	kuadrant-system	kubelet	kuadrant-console-plugin-66c4fb575d-ngn8q	Created	Container created
00:34:13	openshift-jobset-operator	cert-manager-certificates-request-manager	jobset-metrics-cert	Requested	Created new CertificateRequest resource "jobset-metrics-cert-1"
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-serving-cert-1	CertificateIssued	Certificate fetched from issuer successfully
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-acme	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-vault	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-vault	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-ca	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificates-key-manager	jobset-serving-cert	Generated	Stored new private key in temporary Secret resource "jobset-serving-cert-vq4z9"
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-venafi	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-ca	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-venafi	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-acme	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:34:13	openshift-jobset-operator	cert-manager-certificates-key-manager	jobset-metrics-cert	Generated	Stored new private key in temporary Secret resource "jobset-metrics-cert-b4j7l"
00:34:13	openshift-jobset-operator	cert-manager-certificates-request-manager	jobset-serving-cert	Requested	Created new CertificateRequest resource "jobset-serving-cert-1"
00:34:13	openshift-jobset-operator	cert-manager-certificaterequests-approver	jobset-serving-cert-1	cert-manager.io	Certificate request has been approved by cert-manager.io
00:34:14	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ValidatingWebhookConfigurationCreated	Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing
00:34:14	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:34:14	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-metrics-cert-1	CertificateIssued	Certificate fetched from issuer successfully
00:34:14	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:34:14	openshift-jobset-operator	cert-manager-certificaterequests-approver	jobset-metrics-cert-1	cert-manager.io	Certificate request has been approved by cert-manager.io
00:34:14	openshift-jobset-operator	cert-manager-certificates-issuing	jobset-metrics-cert	Issuing	The certificate has been successfully issued
00:34:14	openshift-jobset-operator	cert-manager-certificates-issuing	jobset-serving-cert	Issuing	The certificate has been successfully issued
00:34:14	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	MutatingWebhookConfigurationCreated	Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing
00:34:15	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing
00:34:15	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ServiceMonitorCreated	Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing
00:34:15	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-s59js	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.97s (2.97s including waiting). Image size: 195729000 bytes.
00:34:15	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-s59js	Created	Container created
00:34:15	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-s59js	Started	Container started
00:34:15	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing
00:34:15	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing
00:34:16	openshift-jobset-operator	replicaset-controller	jobset-controller-manager-5dc75844c9	SuccessfulCreate	Created pod: jobset-controller-manager-5dc75844c9-skm5b
00:34:16	openshift-jobset-operator	deployment-controller	jobset-controller-manager	ScalingReplicaSet	Scaled up replica set jobset-controller-manager-5dc75844c9 from 0 to 1
00:34:16	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ConfigMapCreated	Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing
00:34:16	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	DeploymentCreated	Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing
00:34:16	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ValidatingWebhookConfigurationUpdated	Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed
00:34:16	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	MutatingWebhookConfigurationUpdated	Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed
00:34:17	openshift-jobset-operator	kubelet	jobset-controller-manager-5dc75844c9-skm5b	Pulling	Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"
00:34:17	openshift-jobset-operator	multus	jobset-controller-manager-5dc75844c9-skm5b	AddedInterface	Add eth0 [10.134.0.29/23] from ovn-kubernetes
00:34:19	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0
00:34:19	kuadrant-system	replicaset-controller	limitador-limitador-74dfcfb894	SuccessfulDelete	Deleted pod: limitador-limitador-74dfcfb894-66m6m
00:34:19	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-66m6m	Killing	Stopping container limitador
00:34:22	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: status.relatedObjects changed from [{"console.openshift.io" "consoleplugins" "" "monitoring-plugin"} {"" "namespaces" "" "openshift-monitoring"} {"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}] to [{"console.openshift.io" "consoleplugins" "" "kuadrant-console-plugin"} {"" "namespaces" "" "kuadrant-system"} {"console.openshift.io" "consoleplugins" "" "monitoring-plugin"} {"" "namespaces" "" "openshift-monitoring"} {"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}]
00:34:23	openshift-jobset-operator	kubelet	jobset-controller-manager-5dc75844c9-skm5b	Started	Container started
00:34:23	openshift-jobset-operator	kubelet	jobset-controller-manager-5dc75844c9-skm5b	Created	Container created
00:34:23	openshift-jobset-operator	kubelet	jobset-controller-manager-5dc75844c9-skm5b	Pulled	Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 6.514s (6.514s including waiting). Image size: 182184678 bytes.
00:34:24	openshift-jobset-operator	jobset-controller-manager-5dc75844c9-skm5b_3bdab106-5de4-4a47-8c87-186730879d51	6d4f6a47.jobset.x-k8s.io	LeaderElection	jobset-controller-manager-5dc75844c9-skm5b_3bdab106-5de4-4a47-8c87-186730879d51 became leader
00:34:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for odh-ai-gateway-infra namespace
00:34:29	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:34:29	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:34:31 (x2)	openshift-ingress	horizontal-pod-autoscaler	data-science-gateway-data-science-gateway-class	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:34:31 (x2)	openshift-ingress	horizontal-pod-autoscaler	data-science-gateway-data-science-gateway-class	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:34:33	opendatahub	kserve-module-controller-manager-7566cf5fc8-s59js_7c821d2a-6ec7-44ff-93ef-6e8f89af945b	kserve-module-controller-manager	LeaderElection	kserve-module-controller-manager-7566cf5fc8-s59js_7c821d2a-6ec7-44ff-93ef-6e8f89af945b became leader
00:34:46	opendatahub	replicaset-controller	maas-controller-c6c5b9684	SuccessfulCreate	Created pod: maas-controller-c6c5b9684-jdd2p
00:34:46	opendatahub	replicaset-controller	maas-controller-5d4989bfc5	SuccessfulCreate	Created pod: maas-controller-5d4989bfc5-5d2gd
00:34:46	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled up replica set maas-controller-5d4989bfc5 from 0 to 1
00:34:47	opendatahub	multus	maas-controller-c6c5b9684-jdd2p	AddedInterface	Add eth0 [10.133.0.26/23] from ovn-kubernetes
00:34:47	opendatahub	multus	maas-controller-5d4989bfc5-5d2gd	AddedInterface	Add eth0 [10.133.0.25/23] from ovn-kubernetes
00:34:47	opendatahub	kubelet	maas-controller-5d4989bfc5-5d2gd	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd"
00:34:47	opendatahub	kubelet	maas-controller-c6c5b9684-jdd2p	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd"
00:34:53	opendatahub	kubelet	maas-controller-5d4989bfc5-5d2gd	Created	Container created
00:34:53	opendatahub	kubelet	maas-controller-5d4989bfc5-5d2gd	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd" in 6.24s (6.24s including waiting). Image size: 200069654 bytes.
00:34:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenants namespace
00:34:53	opendatahub	kubelet	maas-controller-c6c5b9684-jdd2p	Started	Container started
00:34:53	opendatahub	kubelet	maas-controller-5d4989bfc5-5d2gd	Started	Container started
00:34:53	opendatahub	kubelet	maas-controller-c6c5b9684-jdd2p	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd" in 5.733s (5.733s including waiting). Image size: 200069654 bytes.
00:34:53	opendatahub	kubelet	maas-controller-c6c5b9684-jdd2p	Created	Container created
00:34:55	opendatahub	maas-controller-c6c5b9684-jdd2p_e5020ed3-5ecc-42d2-a391-13bc7b9484e3	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-c6c5b9684-jdd2p_e5020ed3-5ecc-42d2-a391-13bc7b9484e3 became leader
00:34:56	opendatahub	replicaset-controller	usage-logs-tenancy-proxy-9c5d49bcd	SuccessfulCreate	Created pod: usage-logs-tenancy-proxy-9c5d49bcd-4ptr6
00:34:56	opendatahub	deployment-controller	usage-logs-tenancy-proxy	ScalingReplicaSet	Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1
00:34:57	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	FailedMount	MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found
00:34:57	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	FailedMount	MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found
00:34:58	opendatahub	multus	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	AddedInterface	Add eth0 [10.132.0.45/23] from ovn-kubernetes
00:34:58	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	Pulling	Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"
00:35:05	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled down replica set maas-controller-5d4989bfc5 from 1 to 0
00:35:05	opendatahub	kubelet	maas-controller-5d4989bfc5-5d2gd	Killing	Stopping container manager
00:35:05	opendatahub	replicaset-controller	maas-controller-5d4989bfc5	SuccessfulDelete	Deleted pod: maas-controller-5d4989bfc5-5d2gd
00:35:10	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	Created	Container created
00:35:10	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	Pulled	Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 12.318s (12.318s including waiting). Image size: 1089502687 bytes.
00:35:10	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	Started	Container started
00:35:13	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7ddd9cfdc8	SuccessfulCreate	Created pod: istiod-openshift-gateway-7ddd9cfdc8-9s6rb
00:35:13	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1
00:35:14	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-9s6rb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
00:35:14	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-9s6rb	Created	Container created
00:35:14	openshift-ingress	multus	istiod-openshift-gateway-7ddd9cfdc8-9s6rb	AddedInterface	Add eth0 [10.134.0.30/23] from ovn-kubernetes
00:35:14	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-9s6rb	Started	Container started
00:35:15	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-9s6rb	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:35:15	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-9s6rb	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:35:16	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	Killing	Stopping container discovery
00:35:16	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	Unhealthy	Readiness probe failed: Get "http://10.134.0.25:8080/ready": dial tcp 10.134.0.25:8080: connect: connection refused
00:35:16	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-ssc2x	ProbeError	Readiness probe error: Get "http://10.134.0.25:8080/ready": dial tcp 10.134.0.25:8080: connect: connection refused body:
00:35:16	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0
00:35:16	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7876bfcb74	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7876bfcb74-ssc2x
00:35:19	opendatahub	replicaset-controller	kserve-controller-manager-776cc66d47	SuccessfulCreate	Created pod: kserve-controller-manager-776cc66d47-cpp7f
00:35:19	opendatahub	deployment-controller	kserve-controller-manager	ScalingReplicaSet	Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1
00:35:19	opendatahub	replicaset-controller	odh-model-controller-769875db56	SuccessfulCreate	Created pod: odh-model-controller-769875db56-mn6tc
00:35:19	opendatahub	deployment-controller	odh-model-controller	ScalingReplicaSet	Scaled up replica set odh-model-controller-769875db56 from 0 to 1
00:35:19	opendatahub	replicaset-controller	model-serving-api-75bd89fdfc	SuccessfulCreate	Created pod: model-serving-api-75bd89fdfc-xm5x8
00:35:19	opendatahub	replicaset-controller	llmisvc-controller-manager-869d5dcc5d	SuccessfulCreate	Created pod: llmisvc-controller-manager-869d5dcc5d-xk96l
00:35:19	opendatahub	deployment-controller	llmisvc-controller-manager	ScalingReplicaSet	Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1
00:35:19	opendatahub	deployment-controller	model-serving-api	ScalingReplicaSet	Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1
00:35:20	opendatahub	multus	kserve-controller-manager-776cc66d47-cpp7f	AddedInterface	Add eth0 [10.132.0.46/23] from ovn-kubernetes
00:35:20	opendatahub	multus	model-serving-api-75bd89fdfc-xm5x8	AddedInterface	Add eth0 [10.133.0.28/23] from ovn-kubernetes
00:35:20	opendatahub	kubelet	model-serving-api-75bd89fdfc-xm5x8	Pulling	Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"
00:35:20	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-xk96l	Pulling	Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"
00:35:20	opendatahub	multus	llmisvc-controller-manager-869d5dcc5d-xk96l	AddedInterface	Add eth0 [10.133.0.27/23] from ovn-kubernetes
00:35:20	opendatahub	kubelet	kserve-controller-manager-776cc66d47-cpp7f	Pulling	Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"
00:35:20	opendatahub	kubelet	odh-model-controller-769875db56-mn6tc	Pulling	Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"
00:35:20	opendatahub	multus	odh-model-controller-769875db56-mn6tc	AddedInterface	Add eth0 [10.132.0.47/23] from ovn-kubernetes
00:35:22	opendatahub	kubelet	model-serving-api-75bd89fdfc-xm5x8	Pulled	Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.14s (2.14s including waiting). Image size: 184925761 bytes.
00:35:22	opendatahub	kubelet	model-serving-api-75bd89fdfc-xm5x8	Created	Container created
00:35:22	opendatahub	kubelet	model-serving-api-75bd89fdfc-xm5x8	Started	Container started
00:35:23	opendatahub	kubelet	kserve-controller-manager-776cc66d47-cpp7f	Created	Container created
00:35:23	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-xk96l	Started	Container started
00:35:23	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-xk96l	Created	Container created
00:35:23	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-xk96l	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.561s (2.561s including waiting). Image size: 235100981 bytes.
00:35:23	opendatahub	kubelet	kserve-controller-manager-776cc66d47-cpp7f	Started	Container started
00:35:23	opendatahub	kubelet	kserve-controller-manager-776cc66d47-cpp7f	Pulled	Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.506s (3.506s including waiting). Image size: 247676581 bytes.
00:35:24	opendatahub	kubelet	odh-model-controller-769875db56-mn6tc	Created	Container created
00:35:24	opendatahub	odh-model-controller-769875db56-mn6tc_791e903e-fa4c-47b5-981e-af8579e6574b	odh-model-controller.opendatahub.io	LeaderElection	odh-model-controller-769875db56-mn6tc_791e903e-fa4c-47b5-981e-af8579e6574b became leader
00:35:24	opendatahub	llmisvc-controller-manager-869d5dcc5d-xk96l_4ebf788e-0c7a-4312-ba68-e5f3a7864799	llminferenceservice-kserve-controller-manager	LeaderElection	llmisvc-controller-manager-869d5dcc5d-xk96l_4ebf788e-0c7a-4312-ba68-e5f3a7864799 became leader
00:35:24	opendatahub	kubelet	odh-model-controller-769875db56-mn6tc	Started	Container started
00:35:24	opendatahub	kubelet	odh-model-controller-769875db56-mn6tc	Pulled	Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.487s (3.487s including waiting). Image size: 236755567 bytes.
00:35:26	opendatahub	kserve-controller-manager-776cc66d47-cpp7f_769ec4f6-ff13-46b6-9861-948a364e9fba	kserve-controller-manager-leader-lock	LeaderElection	kserve-controller-manager-776cc66d47-cpp7f_769ec4f6-ff13-46b6-9861-948a364e9fba became leader
00:35:27	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for models-as-a-service namespace
00:35:28 (x4)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:35:28 (x4)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:35:43	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:35:43	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:35:44	kuadrant-system	replicaset-controller	authorino-bd5b784c4	SuccessfulDelete	Deleted pod: authorino-bd5b784c4-wpl7c
00:35:44	kuadrant-system	replicaset-controller	authorino-6f6944bcdd	SuccessfulCreate	Created pod: authorino-6f6944bcdd-p2rx5
00:35:44	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-6f6944bcdd from 0 to 1
00:35:44	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-6f6944bcdd from 1 to 0
00:35:44	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-bd5b784c4 from 0 to 1
00:35:44	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-bd5b784c4 from 1 to 0
00:35:44	kuadrant-system	kubelet	authorino-6f6944bcdd-p2rx5	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:35:44	kuadrant-system	multus	authorino-6f6944bcdd-p2rx5	AddedInterface	Add eth0 [10.132.0.48/23] from ovn-kubernetes
00:35:44	kuadrant-system	replicaset-controller	authorino-6f6944bcdd	SuccessfulDelete	Deleted pod: authorino-6f6944bcdd-p2rx5
00:35:44	kuadrant-system	replicaset-controller	authorino-bd5b784c4	SuccessfulCreate	Created pod: authorino-bd5b784c4-wpl7c
00:35:45	kuadrant-system	multus	authorino-6745b67544-cvsbp	AddedInterface	Add eth0 [10.132.0.50/23] from ovn-kubernetes
00:35:45	kuadrant-system	replicaset-controller	authorino-6745b67544	SuccessfulCreate	Created pod: authorino-6745b67544-cvsbp
00:35:45	kuadrant-system	kubelet	authorino-bd5b784c4-wpl7c	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:35:45	kuadrant-system	multus	authorino-bd5b784c4-wpl7c	AddedInterface	Add eth0 [10.132.0.49/23] from ovn-kubernetes
00:35:45	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-6745b67544 from 0 to 1
00:35:45 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Started	Container started
00:35:45	kuadrant-system	kubelet	authorino-6745b67544-cvsbp	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:35:45 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Created	Container created
00:35:45	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:35:46	kuadrant-system	kubelet	authorino-6f6944bcdd-p2rx5	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.724s (1.724s including waiting). Image size: 204096810 bytes.
00:35:46	kuadrant-system	kubelet	authorino-6f6944bcdd-p2rx5	Created	Container created
00:35:46	kuadrant-system	kubelet	authorino-bd5b784c4-wpl7c	Started	Container started
00:35:46	kuadrant-system	kubelet	authorino-bd5b784c4-wpl7c	Created	Container created
00:35:46	kuadrant-system	kubelet	authorino-bd5b784c4-wpl7c	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.626s (1.626s including waiting). Image size: 204096810 bytes.
00:35:46	kuadrant-system	kubelet	authorino-6f6944bcdd-p2rx5	Started	Container started
00:35:47	kuadrant-system	kubelet	authorino-6745b67544-cvsbp	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.326s (1.326s including waiting). Image size: 204096810 bytes.
00:35:47	kuadrant-system	kubelet	authorino-6745b67544-cvsbp	Started	Container started
00:35:47	kuadrant-system	kubelet	authorino-6745b67544-cvsbp	Created	Container created
00:35:47	kuadrant-system	kubelet	authorino-bd5b784c4-wpl7c	Killing	Stopping container authorino
00:35:47	kuadrant-system	kubelet	authorino-6f6944bcdd-p2rx5	Killing	Stopping container authorino
00:35:48	kuadrant-system	replicaset-controller	authorino-56c6c9ddd5	SuccessfulDelete	Deleted pod: authorino-56c6c9ddd5-zvqfw
00:35:48	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-56c6c9ddd5 from 1 to 0
00:35:48	kuadrant-system	kubelet	authorino-56c6c9ddd5-zvqfw	Killing	Stopping container authorino
00:35:50 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	ProbeError	Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
00:35:50 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Unhealthy	Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
00:35:51 (x2)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:35:51 (x2)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:36:21 (x4)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:36:21 (x4)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:36:29	opendatahub	deployment-controller	llmisvc-controller-manager	ScalingReplicaSet	Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1
00:36:29	opendatahub	replicaset-controller	llmisvc-controller-manager-6466c554d8	SuccessfulCreate	Created pod: llmisvc-controller-manager-6466c554d8-g82lt
00:36:30	opendatahub	multus	llmisvc-controller-manager-6466c554d8-g82lt	AddedInterface	Add eth0 [10.133.0.31/23] from ovn-kubernetes
00:36:30	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-g82lt	Pulling	Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"
00:36:31	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-g82lt	Started	Container started
00:36:31	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-g82lt	Created	Container created
00:36:31	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-g82lt	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 716ms (716ms including waiting). Image size: 235100981 bytes.
00:37:02	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-xk96l	Killing	Stopping container manager
00:37:02	opendatahub	replicaset-controller	llmisvc-controller-manager-869d5dcc5d	SuccessfulDelete	Deleted pod: llmisvc-controller-manager-869d5dcc5d-xk96l
00:37:02	opendatahub	deployment-controller	llmisvc-controller-manager	ScalingReplicaSet	Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0
00:37:03	opendatahub	replicaset-controller	ai-gateway-controller-7d85675f98	SuccessfulCreate	Created pod: ai-gateway-controller-7d85675f98-smrj6
00:37:03	opendatahub	deployment-controller	ai-gateway-controller	ScalingReplicaSet	Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1
00:37:04	opendatahub	kubelet	ai-gateway-controller-7d85675f98-smrj6	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"
00:37:04	opendatahub	multus	ai-gateway-controller-7d85675f98-smrj6	AddedInterface	Add eth0 [10.132.0.51/23] from ovn-kubernetes
00:37:07	opendatahub	kubelet	ai-gateway-controller-7d85675f98-smrj6	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.873s (2.873s including waiting). Image size: 183979433 bytes.
00:37:07	opendatahub	kubelet	ai-gateway-controller-7d85675f98-smrj6	Started	Container started
00:37:07	opendatahub	kubelet	ai-gateway-controller-7d85675f98-smrj6	Created	Container created
00:37:09	opendatahub	ai-gateway-controller-7d85675f98-smrj6_ac82debc-687a-4d66-8891-d415805a283e	ai-gateway-controller-leader.opendatahub.io	LeaderElection	ai-gateway-controller-7d85675f98-smrj6_ac82debc-687a-4d66-8891-d415805a283e became leader
00:37:11	openshift-ingress	replicaset-controller	payload-pre-processing-7b98bb678c	SuccessfulCreate	Created pod: payload-pre-processing-7b98bb678c-pgcrl
00:37:11 (x7)	openshift-ingress	replicaset-controller	payload-processing-55fbbbf9dc	FailedCreate	Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
00:37:11	openshift-ingress	replicaset-controller	payload-processing-55fbbbf9dc	SuccessfulCreate	Created pod: payload-processing-55fbbbf9dc-29gp8
00:37:11 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-7b98bb678c	FailedCreate	Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
00:37:11	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
00:37:11	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
00:37:12	openshift-ingress	kubelet	payload-processing-55fbbbf9dc-29gp8	Pulling	Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
00:37:12	openshift-ingress	multus	payload-processing-55fbbbf9dc-29gp8	AddedInterface	Add eth0 [10.132.0.53/23] from ovn-kubernetes
00:37:12	openshift-ingress	multus	payload-pre-processing-7b98bb678c-pgcrl	AddedInterface	Add eth0 [10.132.0.52/23] from ovn-kubernetes
00:37:12	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-pgcrl	Pulling	Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
00:37:15	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-pgcrl	Created	Container created
00:37:15	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-pgcrl	Started	Container started
00:37:15	openshift-ingress	kubelet	payload-processing-55fbbbf9dc-29gp8	Pulled	Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.48s (2.48s including waiting). Image size: 125353965 bytes.
00:37:15	openshift-ingress	kubelet	payload-processing-55fbbbf9dc-29gp8	Created	Container created
00:37:15	openshift-ingress	kubelet	payload-processing-55fbbbf9dc-29gp8	Started	Container started
00:37:15	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-pgcrl	Pulled	Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.748s (2.748s including waiting). Image size: 125353965 bytes.
00:37:18	opendatahub	replicaset-controller	ai-gateway-controller-8967cc4f	SuccessfulCreate	Created pod: ai-gateway-controller-8967cc4f-x2fc2
00:37:18	opendatahub	deployment-controller	ai-gateway-controller	ScalingReplicaSet	Scaled up replica set ai-gateway-controller-8967cc4f from 0 to 1
00:37:19	opendatahub	multus	ai-gateway-controller-8967cc4f-x2fc2	AddedInterface	Add eth0 [10.132.0.54/23] from ovn-kubernetes
00:37:19	opendatahub	kubelet	ai-gateway-controller-8967cc4f-x2fc2	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"
00:37:20	opendatahub	kubelet	ai-gateway-controller-8967cc4f-x2fc2	Created	Container created
00:37:20	opendatahub	llmisvc-controller-manager-6466c554d8-g82lt_2ebc8b38-7dc7-4ad9-9182-f5a5c167aac3	llminferenceservice-kserve-controller-manager	LeaderElection	llmisvc-controller-manager-6466c554d8-g82lt_2ebc8b38-7dc7-4ad9-9182-f5a5c167aac3 became leader
00:37:20	opendatahub	kubelet	ai-gateway-controller-8967cc4f-x2fc2	Started	Container started
00:37:20	opendatahub	kubelet	ai-gateway-controller-8967cc4f-x2fc2	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 982ms (982ms including waiting). Image size: 183979433 bytes.
00:37:32	opendatahub	deployment-controller	ai-gateway-controller	ScalingReplicaSet	Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0
00:37:32	opendatahub	replicaset-controller	ai-gateway-controller-7d85675f98	SuccessfulDelete	Deleted pod: ai-gateway-controller-7d85675f98-smrj6
00:37:32	opendatahub	kubelet	ai-gateway-controller-7d85675f98-smrj6	Killing	Stopping container manager
00:37:36	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for llm namespace
00:37:52	opendatahub	ai-gateway-controller-8967cc4f-x2fc2_ff2e5310-3ec1-4920-836b-f1186e2cef72	ai-gateway-controller-leader.opendatahub.io	LeaderElection	ai-gateway-controller-8967cc4f-x2fc2_ff2e5310-3ec1-4920-836b-f1186e2cef72 became leader
00:38:22	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
00:38:22	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-h59pc
00:38:22	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-4wnxp
00:38:22	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 3; reason: cpu resource utilization (percentage of request) above target
00:38:22	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 1 to 3
00:38:22	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	AddedInterface	Add eth0 [10.134.0.36/23] from ovn-kubernetes
00:38:23	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
00:38:23	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	AddedInterface	Add eth0 [10.133.0.32/23] from ovn-kubernetes
00:38:27	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	Created	Container created
00:38:27	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4s (4s including waiting). Image size: 183555333 bytes.
00:38:27	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	Started	Container started
00:38:33 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	ProbeError	Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
00:38:33 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	Unhealthy	Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
00:38:36	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 13.215s (13.215s including waiting). Image size: 183555333 bytes.
00:38:36	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	Started	Container started
00:38:36	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	Created	Container created
00:38:37	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	AddedInterface	Add eth0 [10.134.0.37/23] from ovn-kubernetes
00:38:37	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-9cx9g
00:38:37	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-gjtnr
00:38:37	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	AddedInterface	Add eth0 [10.132.0.58/23] from ovn-kubernetes
00:38:37	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 6; reason: cpu resource utilization (percentage of request) above target
00:38:37	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-td7wh
00:38:37	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	AddedInterface	Add eth0 [10.133.0.33/23] from ovn-kubernetes
00:38:37	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 3 to 6
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	Started	Container started
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	Created	Container created
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	Created	Container created
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	Created	Container created
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	Started	Container started
00:38:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	Started	Container started
00:38:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for premium-users-namespace namespace
00:38:41	kuadrant-system	replicaset-controller	authorino-6f48f74795	SuccessfulCreate	Created pod: authorino-6f48f74795-6sh8x
00:38:41	kuadrant-system	kubelet	authorino-6f48f74795-6sh8x	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:38:41	kuadrant-system	multus	authorino-6f48f74795-6sh8x	AddedInterface	Add eth0 [10.132.0.59/23] from ovn-kubernetes
00:38:43	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for maas-admin namespace
00:38:43	kuadrant-system	kubelet	authorino-6f48f74795-6sh8x	Started	Container started
00:38:43 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	ProbeError	Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
00:38:43	kuadrant-system	kubelet	authorino-6f48f74795-6sh8x	Created	Container created
00:38:43 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	Unhealthy	Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
00:38:43	kuadrant-system	kubelet	authorino-6f48f74795-6sh8x	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.416s (1.416s including waiting). Image size: 204096810 bytes.
00:38:44 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	ProbeError	Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
00:38:44 (x2)	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	(combined from similar events): Scaled down replica set authorino-6745b67544 from 1 to 0
00:38:44 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	Unhealthy	Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
00:38:44	kuadrant-system	kubelet	authorino-6745b67544-cvsbp	Killing	Stopping container authorino
00:38:44	kuadrant-system	replicaset-controller	authorino-6745b67544	SuccessfulDelete	Deleted pod: authorino-6745b67544-cvsbp
00:38:45 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	ProbeError	Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
00:38:45 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	Unhealthy	Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
00:38:45 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	Unhealthy	Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
00:38:45 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	ProbeError	Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
00:39:19	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-ait-wrong-802eb074 namespace
00:39:19	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-migrate-eda5d57d namespace
00:39:20	openshift-ingress	deployment-controller	e2e-ait-e8418376-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-e8418376-openshift-default-5558c64d77 from 0 to 1
00:39:20	openshift-ingress	replicaset-controller	e2e-ait-e8418376-openshift-default-5558c64d77	SuccessfulCreate	Created pod: e2e-ait-e8418376-openshift-default-5558c64d77-kvflp
00:39:20	openshift-ingress	gateway_labeler_controller	e2e-ait-e8418376	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e8418376
00:39:20	openshift-ingress	gateway_labeler_controller	e2e-ait-d348dc13	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d348dc13
00:39:20	openshift-ingress	deployment-controller	e2e-ait-d348dc13-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-d348dc13-openshift-default-585645d77c from 0 to 1
00:39:20	openshift-ingress	replicaset-controller	e2e-ait-d348dc13-openshift-default-585645d77c	SuccessfulCreate	Created pod: e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz
00:39:20	openshift-ingress	gateway_labeler_controller	e2e-migrate-eda5d57d-gw	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-eda5d57d-gw
00:39:21	openshift-ingress	multus	e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	AddedInterface	Add eth0 [10.132.0.61/23] from ovn-kubernetes
00:39:21	openshift-ingress	deployment-controller	e2e-migrate-eda5d57d-gw-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7 from 0 to 1
00:39:21	openshift-ingress	replicaset-controller	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7	SuccessfulCreate	Created pod: e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm
00:39:21	openshift-ingress	multus	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	AddedInterface	Add eth0 [10.132.0.60/23] from ovn-kubernetes
00:39:21	openshift-ingress	multus	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	AddedInterface	Add eth0 [10.132.0.62/23] from ovn-kubernetes
00:39:22	openshift-ingress	deployment-controller	e2e-ait-d1405aac-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-d1405aac-openshift-default-b59c7679 from 0 to 1
00:39:22	openshift-ingress	gateway_labeler_controller	e2e-ait-d1405aac	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d1405aac
00:39:22	openshift-ingress	replicaset-controller	e2e-ait-d1405aac-openshift-default-b59c7679	SuccessfulCreate	Created pod: e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k
00:39:23	openshift-ingress	multus	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	AddedInterface	Add eth0 [10.134.0.38/23] from ovn-kubernetes
00:39:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ait-e8418376 namespace
00:39:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ait-d348dc13 namespace
00:39:27	openshift-ingress	gateway_labeler_controller	e2e-derive-9e0a116f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9e0a116f
00:39:28	openshift-ingress	deployment-controller	payload-pre-processing-e2e-migrate-eda5d57d	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447 from 0 to 1
00:39:28	openshift-ingress	multus	e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	AddedInterface	Add eth0 [10.132.0.63/23] from ovn-kubernetes
00:39:28	openshift-ingress	deployment-controller	payload-processing-e2e-migrate-eda5d57d	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-migrate-eda5d57d-68bb477fc9 from 0 to 1
00:39:28	openshift-ingress	replicaset-controller	e2e-derive-9e0a116f-openshift-default-7fbd465d69	SuccessfulCreate	Created pod: e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2
00:39:28	openshift-ingress	deployment-controller	e2e-derive-9e0a116f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-derive-9e0a116f-openshift-default-7fbd465d69 from 0 to 1
00:39:29	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447	SuccessfulCreate	Created pod: payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk
00:39:29 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-migrate-eda5d57d-68bb477fc9	FailedCreate	Error creating: pods "payload-processing-e2e-migrate-eda5d57d-68bb477fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eda5d57d: serviceaccount "payload-processing-e2e-migrate-eda5d57d" not found
00:39:29	openshift-ingress	replicaset-controller	payload-processing-e2e-migrate-eda5d57d-68bb477fc9	SuccessfulCreate	Created pod: payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp
00:39:29	openshift-ingress	multus	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk	AddedInterface	Add eth0 [10.134.0.39/23] from ovn-kubernetes
00:39:29 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447	FailedCreate	Error creating: pods "payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eda5d57d: serviceaccount "payload-processing-e2e-migrate-eda5d57d" not found
00:39:30	openshift-ingress	multus	payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp	AddedInterface	Add eth0 [10.134.0.40/23] from ovn-kubernetes
00:39:30	openshift-ingress	kubelet	payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp	Pulling	Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
00:39:30	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ait-d1405aac namespace
00:39:30	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk	Pulling	Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
00:39:32	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk	Pulled	Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.86s (2.86s including waiting). Image size: 125353965 bytes.
00:39:32	openshift-ingress	kubelet	payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp	Created	Container created
00:39:32	openshift-ingress	kubelet	payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp	Pulled	Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.777s (2.777s including waiting). Image size: 125353965 bytes.
00:39:32	openshift-ingress	kubelet	payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp	Started	Container started
00:39:32	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk	Started	Container started
00:39:32	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk	Created	Container created
00:39:33	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-e8418376	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-e8418376-74564c5647 from 0 to 1
00:39:33 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-e8418376-74564c5647	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-e8418376-74564c5647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8418376: serviceaccount "payload-processing-e2e-ait-e8418376" not found
00:39:33 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-e8418376-5f48f6494c	FailedCreate	Error creating: pods "payload-processing-e2e-ait-e8418376-5f48f6494c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8418376: serviceaccount "payload-processing-e2e-ait-e8418376" not found
00:39:33	openshift-ingress	deployment-controller	payload-processing-e2e-ait-e8418376	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-e8418376-5f48f6494c from 0 to 1
00:39:34	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-e8418376-5f48f6494c	SuccessfulCreate	Created pod: payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh
00:39:34	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k	Created	Container created
00:39:34	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k	Started	Container started
00:39:34	openshift-ingress	multus	payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh	AddedInterface	Add eth0 [10.132.0.65/23] from ovn-kubernetes
00:39:34	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-e8418376-74564c5647	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k
00:39:34	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:34	openshift-ingress	multus	payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k	AddedInterface	Add eth0 [10.134.0.41/23] from ovn-kubernetes
00:39:34	openshift-ingress	kubelet	payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:35	openshift-ingress	kubelet	payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh	Started	Container started
00:39:35	openshift-ingress	kubelet	payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh	Created	Container created
00:39:35	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-derive-9e0a116f namespace
00:39:36	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-d348dc13-7ff9544c9f	SuccessfulCreate	Created pod: payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5
00:39:36	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-d348dc13-664f8fddc5	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh
00:39:36	openshift-ingress	deployment-controller	payload-processing-e2e-ait-d348dc13	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-d348dc13-7ff9544c9f from 0 to 1
00:39:36	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-d348dc13	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-d348dc13-664f8fddc5 from 0 to 1
00:39:36 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-d348dc13-664f8fddc5	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d348dc13: serviceaccount "payload-processing-e2e-ait-d348dc13" not found
00:39:36 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-d348dc13-7ff9544c9f	FailedCreate	Error creating: pods "payload-processing-e2e-ait-d348dc13-7ff9544c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d348dc13: serviceaccount "payload-processing-e2e-ait-d348dc13" not found
00:39:37	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh	Started	Container started
00:39:37	openshift-ingress	multus	payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5	AddedInterface	Add eth0 [10.134.0.44/23] from ovn-kubernetes
00:39:37	openshift-ingress	kubelet	payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5	Created	Container created
00:39:37	openshift-ingress	kubelet	payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5	Started	Container started
00:39:37	openshift-ingress	multus	payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh	AddedInterface	Add eth0 [10.134.0.43/23] from ovn-kubernetes
00:39:37	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh	Created	Container created
00:39:37	openshift-ingress	kubelet	payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:37	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:38 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-d1405aac-6975c8b857	FailedCreate	Error creating: pods "payload-processing-e2e-ait-d1405aac-6975c8b857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d1405aac: serviceaccount "payload-processing-e2e-ait-d1405aac" not found
00:39:38	openshift-ingress	deployment-controller	payload-processing-e2e-ait-d1405aac	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-d1405aac-6975c8b857 from 0 to 1
00:39:38 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d1405aac: serviceaccount "payload-processing-e2e-ait-d1405aac" not found
00:39:38	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-d1405aac	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7 from 0 to 1
00:39:39	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn	Started	Container started
00:39:39	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn	Created	Container created
00:39:39	openshift-ingress	multus	payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn	AddedInterface	Add eth0 [10.132.0.66/23] from ovn-kubernetes
00:39:39	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:39	openshift-ingress	multus	payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg	AddedInterface	Add eth0 [10.132.0.67/23] from ovn-kubernetes
00:39:39	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-d1405aac-6975c8b857	SuccessfulCreate	Created pod: payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg
00:39:39	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn
00:39:40	openshift-ingress	kubelet	payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:40	openshift-ingress	kubelet	payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg	Created	Container created
00:39:40	openshift-ingress	kubelet	payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg	Started	Container started
00:39:48	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-derive-9e0a116f-64d745d647	SuccessfulCreate	Created pod: payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj
00:39:48	openshift-ingress	deployment-controller	payload-processing-e2e-derive-9e0a116f	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-derive-9e0a116f-5f456bc485 from 0 to 1
00:39:48	openshift-ingress	replicaset-controller	payload-processing-e2e-derive-9e0a116f-5f456bc485	SuccessfulCreate	Created pod: payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl
00:39:48 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-derive-9e0a116f-5f456bc485	FailedCreate	Error creating: pods "payload-processing-e2e-derive-9e0a116f-5f456bc485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9e0a116f: serviceaccount "payload-processing-e2e-derive-9e0a116f" not found
00:39:48 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-derive-9e0a116f-64d745d647	FailedCreate	Error creating: pods "payload-pre-processing-e2e-derive-9e0a116f-64d745d647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9e0a116f: serviceaccount "payload-processing-e2e-derive-9e0a116f" not found
00:39:48	openshift-ingress	deployment-controller	payload-pre-processing-e2e-derive-9e0a116f	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-derive-9e0a116f-64d745d647 from 0 to 1
00:39:49	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj	Created	Container created
00:39:49	openshift-ingress	multus	payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj	AddedInterface	Add eth0 [10.134.0.45/23] from ovn-kubernetes
00:39:49	openshift-ingress	kubelet	payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:49	openshift-ingress	multus	payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl	AddedInterface	Add eth0 [10.132.0.68/23] from ovn-kubernetes
00:39:49	openshift-ingress	kubelet	payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl	Created	Container created
00:39:49	openshift-ingress	kubelet	payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl	Started	Container started
00:39:49	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:39:49	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj	Started	Container started
00:39:50 (x2)	openshift-ingress	kubelet	e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:39:50 (x2)	openshift-ingress	kubelet	e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	Started	Container started
00:39:50 (x2)	openshift-ingress	kubelet	e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	Created	Container created
00:39:57 (x6)	openshift-ingress	kubelet	e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	Unhealthy	Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
00:39:57 (x6)	openshift-ingress	kubelet	e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	ProbeError	Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
00:39:59 (x2)	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:39:59 (x2)	openshift-ingress	kubelet	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	Started	Container started
00:39:59 (x2)	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	Started	Container started
00:39:59 (x2)	openshift-ingress	kubelet	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	Created	Container created
00:39:59 (x2)	openshift-ingress	kubelet	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:39:59 (x2)	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	Created	Container created
00:40:05 (x5)	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	Unhealthy	Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
00:40:05 (x5)	openshift-ingress	kubelet	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	ProbeError	Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
00:40:05 (x5)	openshift-ingress	kubelet	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	Unhealthy	Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
00:40:05 (x5)	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	ProbeError	Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
00:40:09	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	ProbeError	Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:40:09	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Unhealthy	Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:40:10 (x2)	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Started	Container started
00:40:10 (x2)	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:40:10 (x2)	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Created	Container created
00:40:16 (x5)	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	ProbeError	Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
00:40:16 (x5)	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Unhealthy	Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
00:40:19 (x2)	openshift-ingress	kubelet	e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	Started	Container started
00:40:19 (x2)	openshift-ingress	kubelet	e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	Created	Container created
00:40:19 (x2)	openshift-ingress	kubelet	e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:40:21 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-d348dc13-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:21	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-e8418376-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:40:21 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-migrate-eda5d57d-gw-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:21 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-migrate-eda5d57d-gw-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:21 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-d348dc13-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:21	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-e8418376-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:40:23	openshift-ingress	kubelet	payload-processing-e2e-ait-d348dc13-7ff9544c9f-j8pr5	Killing	Stopping container payload-processing
00:40:23 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-d1405aac-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:23 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-d1405aac-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:23	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d348dc13-664f8fddc5-6fhqh	Killing	Stopping container payload-pre-processing
00:40:25 (x5)	openshift-ingress	kubelet	e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	ProbeError	Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
00:40:25 (x5)	openshift-ingress	kubelet	e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	Unhealthy	Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
00:40:28	openshift-ingress	kubelet	payload-processing-e2e-ait-d1405aac-6975c8b857-blbpg	Killing	Stopping container payload-processing
00:40:28 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-derive-9e0a116f-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:28 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-derive-9e0a116f-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:29	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-d1405aac-cc4dddbd7-xxdgn	Killing	Stopping container payload-pre-processing
00:40:31	openshift-ingress	kubelet	payload-processing-e2e-migrate-eda5d57d-68bb477fc9-rd4dp	Killing	Stopping container payload-processing
00:40:31	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eda5d57d-5db6f45447-cgpgk	Killing	Stopping container payload-pre-processing
00:40:35	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	Killing	Stopping container istio-proxy
00:40:35	openshift-ingress	kubelet	e2e-ait-d348dc13-openshift-default-585645d77c-4xbpz	Killing	Stopping container istio-proxy
00:40:36	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 0 to 1
00:40:36	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:40:36	openshift-ingress	gateway_labeler_controller	e2e-worker-w4-e5b28f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-e5b28f
00:40:36	openshift-ingress	kubelet	e2e-migrate-eda5d57d-gw-openshift-default-85fd5449c7-8phrm	Killing	Stopping container istio-proxy
00:40:36	openshift-ingress	kubelet	e2e-ait-d1405aac-openshift-default-b59c7679-kvs2k	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:40:36	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7
00:40:36	openshift-ingress	gateway_labeler_controller	e2e-worker-w0-902076	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-902076
00:40:37	openshift-ingress	gateway_labeler_controller	e2e-worker-w3-e16993	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-e16993
00:40:37	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-mprgk
00:40:37	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 0 to 1
00:40:37	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	AddedInterface	Add eth0 [10.134.0.49/23] from ovn-kubernetes
00:40:37	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	AddedInterface	Add eth0 [10.132.0.72/23] from ovn-kubernetes
00:40:38	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 0 to 1
00:40:38	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n
00:40:39	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	AddedInterface	Add eth0 [10.134.0.51/23] from ovn-kubernetes
00:40:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-w4-e5b28f namespace
00:40:42	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-w0-902076 namespace
00:40:43	openshift-ingress	horizontal-pod-autoscaler	e2e-derive-9e0a116f-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:40:43	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-e8418376-74564c5647-6qd6k	Killing	Stopping container payload-pre-processing
00:40:43	openshift-ingress	horizontal-pod-autoscaler	e2e-derive-9e0a116f-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:40:43	openshift-ingress	kubelet	payload-processing-e2e-ait-e8418376-5f48f6494c-tbqzh	Killing	Stopping container payload-processing
00:40:44	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-w3-e16993 namespace
00:40:47 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e5b28f: serviceaccount "payload-processing-e2e-worker-w4-e5b28f" not found
00:40:47 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e5b28f: serviceaccount "payload-processing-e2e-worker-w4-e5b28f" not found
00:40:47	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w4-e5b28f	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95 from 0 to 1
00:40:47	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w4-e5b28f	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f from 0 to 1
00:40:48	openshift-ingress	multus	payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh	AddedInterface	Add eth0 [10.132.0.73/23] from ovn-kubernetes
00:40:48	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762
00:40:48	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh
00:40:48	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh	Started	Container started
00:40:48	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh	Created	Container created
00:40:48	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:40:49	openshift-ingress	multus	payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762	AddedInterface	Add eth0 [10.134.0.52/23] from ovn-kubernetes
00:40:49	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762	Created	Container created
00:40:49	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:40:49	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762	Started	Container started
00:40:50 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w3-e16993-6f96699995	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w3-e16993-6f96699995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-e16993: serviceaccount "payload-processing-e2e-worker-w3-e16993" not found
00:40:50	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w3-e16993-6f96699995	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf
00:40:50	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w3-e16993	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w3-e16993-6f96699995 from 0 to 1
00:40:50	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w3-e16993	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w3-e16993-cb676db4c from 0 to 1
00:40:50	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w3-e16993-cb676db4c	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8
00:40:50 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w3-e16993-cb676db4c	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w3-e16993-cb676db4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-e16993: serviceaccount "payload-processing-e2e-worker-w3-e16993" not found
00:40:51	openshift-ingress	multus	payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8	AddedInterface	Add eth0 [10.132.0.75/23] from ovn-kubernetes
00:40:51	openshift-ingress	multus	payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf	AddedInterface	Add eth0 [10.132.0.74/23] from ovn-kubernetes
00:40:51	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf	Started	Container started
00:40:51	openshift-ingress	kubelet	payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8	Started	Container started
00:40:51 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-e8418376-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:51	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf	Created	Container created
00:40:51 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-e8418376-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:51	openshift-ingress	kubelet	payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:40:51	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:40:51	openshift-ingress	kubelet	payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8	Created	Container created
00:40:52	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w0-902076	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7 from 0 to 1
00:40:52 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-902076: serviceaccount "payload-processing-e2e-worker-w0-902076" not found
00:40:52	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:52	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w0-902076	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w0-902076-664f4c595 from 0 to 1
00:40:52 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w0-902076-664f4c595	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w0-902076-664f4c595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-902076: serviceaccount "payload-processing-e2e-worker-w0-902076" not found
00:40:52	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:40:53	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	Started	Container started
00:40:53	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-902076-664f4c595-qstk6	Started	Container started
00:40:53	openshift-ingress	multus	payload-processing-e2e-worker-w0-902076-664f4c595-qstk6	AddedInterface	Add eth0 [10.132.0.76/23] from ovn-kubernetes
00:40:53	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w0-902076-664f4c595	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w0-902076-664f4c595-qstk6
00:40:53	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	Created	Container created
00:40:53	openshift-ingress	multus	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	AddedInterface	Add eth0 [10.134.0.53/23] from ovn-kubernetes
00:40:53	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:40:53	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:40:53	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p
00:40:53	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:40:53	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-902076-664f4c595-qstk6	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:40:53	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-902076-664f4c595-qstk6	Created	Container created
00:40:58	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-9e0a116f-64d745d647-tszxj	Killing	Stopping container payload-pre-processing
00:40:58	openshift-ingress	kubelet	payload-processing-e2e-derive-9e0a116f-5f456bc485-t24gl	Killing	Stopping container payload-processing
00:41:12	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Killing	Stopping container istio-proxy
00:41:14	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 0 to 1
00:41:14 (x2)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	Started	Container started
00:41:14 (x2)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	Created	Container created
00:41:14 (x2)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:41:14	openshift-ingress	kubelet	e2e-derive-9e0a116f-openshift-default-7fbd465d69-qxcn2	Killing	Stopping container istio-proxy
00:41:14	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8
00:41:14	openshift-ingress	gateway_labeler_controller	e2e-worker-w2-ee1538	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-ee1538
00:41:15	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w1-552952-openshift-default-855478bdc from 0 to 1
00:41:15	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-7blqg
00:41:15	openshift-ingress	gateway_labeler_controller	e2e-worker-w1-552952	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-552952
00:41:15	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	AddedInterface	Add eth0 [10.132.0.79/23] from ovn-kubernetes
00:41:16	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	AddedInterface	Add eth0 [10.134.0.55/23] from ovn-kubernetes
00:41:17	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:41:17	openshift-ingress	kubelet	e2e-ait-e8418376-openshift-default-5558c64d77-kvflp	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:41:19	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-w2-ee1538 namespace
00:41:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-w1-552952 namespace
00:41:20 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	ProbeError	Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
00:41:20 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	Unhealthy	Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
00:41:22	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t
00:41:22	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx
00:41:22	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	SuccessfulRescale	New size: 3; reason: cpu resource utilization (percentage of request) above target
00:41:22	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w2-ee1538	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w2-ee1538-759dbdcf97 from 0 to 1
00:41:22 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-ee1538: serviceaccount "payload-processing-e2e-worker-w2-ee1538" not found
00:41:22	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz
00:41:22	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w2-ee1538	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99 from 0 to 1
00:41:22	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 1 to 3
00:41:22 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w2-ee1538-759dbdcf97	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w2-ee1538-759dbdcf97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-ee1538: serviceaccount "payload-processing-e2e-worker-w2-ee1538" not found
00:41:23	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	Started	Container started
00:41:23	openshift-ingress	kubelet	payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:41:23	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	Created	Container created
00:41:23	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:41:23	openshift-ingress	multus	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz	AddedInterface	Add eth0 [10.132.0.80/23] from ovn-kubernetes
00:41:23	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:41:23	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz	Created	Container created
00:41:23	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz	Started	Container started
00:41:23	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w2-ee1538-759dbdcf97	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8
00:41:23	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	AddedInterface	Add eth0 [10.133.0.35/23] from ovn-kubernetes
00:41:23	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	Created	Container created
00:41:23	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:41:23	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	AddedInterface	Add eth0 [10.134.0.56/23] from ovn-kubernetes
00:41:23	openshift-ingress	multus	payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8	AddedInterface	Add eth0 [10.132.0.81/23] from ovn-kubernetes
00:41:23	openshift-ingress	kubelet	payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8	Started	Container started
00:41:23	openshift-ingress	kubelet	payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8	Created	Container created
00:41:23	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	Started	Container started
00:41:24 (x2)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:41:24 (x2)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	Created	Container created
00:41:24 (x2)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:41:24 (x2)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	Created	Container created
00:41:24 (x2)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	Started	Container started
00:41:24 (x2)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	Started	Container started
00:41:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-w4-e5b28f namespace
00:41:29 (x5)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	Unhealthy	Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
00:41:29 (x5)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	ProbeError	Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
00:41:29 (x5)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	Unhealthy	Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
00:41:29 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w1-552952-56b96b5f5c	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w1-552952-56b96b5f5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-552952: serviceaccount "payload-processing-e2e-worker-w1-552952" not found
00:41:29	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w1-552952	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w1-552952-56b96b5f5c from 0 to 1
00:41:29 (x5)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	ProbeError	Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
00:41:29 (x5)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	ProbeError	Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
00:41:29 (x5)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	Unhealthy	Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
00:41:29 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	Unhealthy	Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
00:41:29 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-552952: serviceaccount "payload-processing-e2e-worker-w1-552952" not found
00:41:29	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w1-552952	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f from 0 to 1
00:41:29 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	ProbeError	Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
00:41:30	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w1-552952-56b96b5f5c	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96
00:41:30	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg
00:41:30	openshift-ingress	multus	payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96	AddedInterface	Add eth0 [10.132.0.83/23] from ovn-kubernetes
00:41:30	openshift-ingress	multus	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg	AddedInterface	Add eth0 [10.132.0.82/23] from ovn-kubernetes
00:41:30	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:41:30	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg	Created	Container created
00:41:30	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg	Started	Container started
00:41:31	openshift-ingress	kubelet	payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96	Started	Container started
00:41:31	openshift-ingress	kubelet	payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96	Created	Container created
00:41:31	openshift-ingress	kubelet	payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:41:33	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-w0-902076 namespace
00:41:37	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:41:37 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:41:37 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:41:37	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:41:39	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-w3-e16993 namespace
00:41:54 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:41:54 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:41:58 (x2)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	Created	Container created
00:41:58 (x2)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:41:58 (x2)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	Started	Container started
00:42:03 (x5)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	ProbeError	Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
00:42:03 (x5)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	Unhealthy	Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
00:42:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	Unhealthy	Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:42:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	ProbeError	Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:42:06 (x2)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	Started	Container started
00:42:06 (x2)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	Created	Container created
00:42:06 (x2)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:42:12 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	Unhealthy	Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
00:42:12 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	ProbeError	Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
00:42:15 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:42:15 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:42:16 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:42:16 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:42:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-w2-ee1538 namespace
00:42:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-w1-552952 namespace
00:42:30	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:42:30	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:42:31 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:42:31 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:42:37	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x
00:42:38	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	Started	Container started
00:42:38	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	AddedInterface	Add eth0 [10.132.0.86/23] from ovn-kubernetes
00:42:38	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	Created	Container created
00:42:38	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:42:44 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	ProbeError	Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
00:42:44 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	Unhealthy	Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
00:43:54	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-848f6bf8bc from 6 to 5
00:43:54	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 5; reason: All metrics below target
00:43:54	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gbc5r	Killing	Stopping container istio-proxy
00:43:54	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-gbc5r
00:44:39	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6
00:44:39	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 3 to 4
00:44:39	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	AddedInterface	Add eth0 [10.134.0.64/23] from ovn-kubernetes
00:44:40	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	Started	Container started
00:44:40	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	Created	Container created
00:44:40	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:44:46 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	Unhealthy	Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
00:44:46 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	ProbeError	Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
00:44:55	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	AddedInterface	Add eth0 [10.132.0.90/23] from ovn-kubernetes
00:44:55	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	AddedInterface	Add eth0 [10.133.0.45/23] from ovn-kubernetes
00:44:55 (x2)	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	(combined from similar events): Created pod: maas-default-gateway-openshift-default-848f6bf8bc-596nd
00:44:55	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	AddedInterface	Add eth0 [10.134.0.65/23] from ovn-kubernetes
00:44:55	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp
00:44:55	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-4fnf7
00:44:55	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 5 to 10
00:44:55	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-gdtdr
00:44:55	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-kpl6n
00:44:55	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-596nd	AddedInterface	Add eth0 [10.132.0.91/23] from ovn-kubernetes
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Started	Container started
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	Created	Container created
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	Started	Container started
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	Started	Container started
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	Created	Container created
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	Created	Container created
00:44:56	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	AddedInterface	Add eth0 [10.132.0.89/23] from ovn-kubernetes
00:44:56	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	AddedInterface	Add eth0 [10.133.0.46/23] from ovn-kubernetes
00:44:56	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:44:56	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Created	Container created
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Created	Container created
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Created	Container created
00:44:56	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Started	Container started
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	Started	Container started
00:44:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Started	Container started
00:45:00	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2
00:45:01 (x5)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Unhealthy	Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
00:45:01 (x5)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	ProbeError	Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
00:45:01	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Created	Container created
00:45:01	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	AddedInterface	Add eth0 [10.134.0.69/23] from ovn-kubernetes
00:45:01	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Started	Container started
00:45:01	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:45:02	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-48xgr
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	ProbeError	Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
00:45:03	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	ProbeError	Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	Unhealthy	Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
00:45:03	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	Created	Container created
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	ProbeError	Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
00:45:03	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:45:03	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	Started	Container started
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	ProbeError	Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
00:45:03	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	AddedInterface	Add eth0 [10.132.0.92/23] from ovn-kubernetes
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	Unhealthy	Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
00:45:03	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Unhealthy	Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	ProbeError	Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	ProbeError	Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Unhealthy	Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Unhealthy	Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
00:45:03 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	Unhealthy	Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
00:45:06 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Unhealthy	Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:45:06 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	ProbeError	Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:45:07 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Unhealthy	Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
00:45:07 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	ProbeError	Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:45:07 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	ProbeError	Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
00:45:07 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Unhealthy	Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:45:09 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	Unhealthy	Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:45:09 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	ProbeError	Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:45:09 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	ProbeError	Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:45:09 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	Unhealthy	Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:45:10 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	ProbeError	Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:45:10 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	Unhealthy	Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:45:11 (x7)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	ProbeError	Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
00:45:11 (x7)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	Unhealthy	Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
00:46:30	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 2 to 3
00:46:30	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 3; reason: cpu resource utilization (percentage of request) above target
00:46:30	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx
00:46:31	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	Started	Container started
00:46:31	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:46:31	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	Created	Container created
00:46:31	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	AddedInterface	Add eth0 [10.133.0.52/23] from ovn-kubernetes
00:46:37 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	Unhealthy	Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
00:46:37 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	ProbeError	Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
00:46:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Unhealthy	Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:46:38	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	ProbeError	Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:48:04	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 3; reason: cpu resource utilization (percentage of request) above target
00:48:04	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	Created	Container created
00:48:04	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:48:04	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	AddedInterface	Add eth0 [10.133.0.54/23] from ovn-kubernetes
00:48:04	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w1-552952-openshift-default-855478bdc from 2 to 3
00:48:04	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c
00:48:04	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	Started	Container started
00:48:11 (x7)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	Unhealthy	Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
00:48:11 (x7)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	ProbeError	Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
00:48:15	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb
00:48:15	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 5; reason: cpu resource utilization (percentage of request) above target
00:48:15	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m
00:48:15	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 3 to 5
00:48:16	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	Started	Container started
00:48:16	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:48:16	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	Created	Container created
00:48:16	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	AddedInterface	Add eth0 [10.134.0.77/23] from ovn-kubernetes
00:48:16	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	AddedInterface	Add eth0 [10.132.0.95/23] from ovn-kubernetes
00:48:16	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:48:17	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	Created	Container created
00:48:17	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	Started	Container started
00:48:23 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	ProbeError	Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
00:48:23 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	Unhealthy	Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
00:48:23 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	Unhealthy	Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
00:48:23 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	ProbeError	Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
00:48:33	openshift-insights	job-controller	periodic-gathering-fm2r2	SuccessfulCreate	Created pod: periodic-gathering-fm2r2-k668x
00:48:34	openshift-insights	multus	periodic-gathering-fm2r2-k668x	AddedInterface	Add eth0 [10.132.0.96/23] from ovn-kubernetes
00:48:34	openshift-insights	kubelet	periodic-gathering-fm2r2-k668x	Started	Container started
00:48:34	openshift-insights	kubelet	periodic-gathering-fm2r2-k668x	Created	Container created
00:48:34	openshift-insights	kubelet	periodic-gathering-fm2r2-k668x	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4f6a06f8fd2e41c1080f083d1fd9114deee35547a92f4e3cf5bdaf6d1a72aa7" already present on machine and can be accessed by the pod
00:48:46	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 5 to 7
00:48:46	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	AddedInterface	Add eth0 [10.134.0.83/23] from ovn-kubernetes
00:48:46	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c
00:48:46	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq
00:48:46	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:48:46	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 7; reason: cpu resource utilization (percentage of request) above target
00:48:46	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	AddedInterface	Add eth0 [10.133.0.55/23] from ovn-kubernetes
00:48:47	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Created	Container created
00:48:47	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:48:47	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	Created	Container created
00:48:47	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	Started	Container started
00:48:47	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Started	Container started
00:48:53 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Unhealthy	Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
00:48:53 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	ProbeError	Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
00:48:53 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	Unhealthy	Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
00:48:53 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	ProbeError	Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
00:49:01	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n
00:49:01	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs
00:49:01	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	AddedInterface	Add eth0 [10.134.0.86/23] from ovn-kubernetes
00:49:01	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 10; reason: cpu resource utilization (percentage of request) above target
00:49:01	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	(combined from similar events): Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56
00:49:01	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 7 to 10
00:49:01	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	AddedInterface	Add eth0 [10.132.0.97/23] from ovn-kubernetes
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	Created	Container created
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	Started	Container started
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	Created	Container created
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	Created	Container created
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	Started	Container started
00:49:02	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	Started	Container started
00:49:02	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	AddedInterface	Add eth0 [10.133.0.56/23] from ovn-kubernetes
00:49:04	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj
00:49:04	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 6; reason: cpu resource utilization (percentage of request) above target
00:49:04	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w1-552952-openshift-default-855478bdc from 3 to 6
00:49:04	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x
00:49:04	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7
00:49:05	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	AddedInterface	Add eth0 [10.133.0.57/23] from ovn-kubernetes
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	Created	Container created
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	Started	Container started
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	Started	Container started
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	Created	Container created
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:05	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	AddedInterface	Add eth0 [10.132.0.98/23] from ovn-kubernetes
00:49:05	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	AddedInterface	Add eth0 [10.134.0.88/23] from ovn-kubernetes
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	Created	Container created
00:49:05	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	Started	Container started
00:49:09 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	ProbeError	Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
00:49:09 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	Unhealthy	Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
00:49:09 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	ProbeError	Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
00:49:09 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	Unhealthy	Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
00:49:09 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	ProbeError	Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
00:49:09 (x7)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	Unhealthy	Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
00:49:11 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	ProbeError	Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
00:49:11 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	Unhealthy	Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
00:49:11 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	ProbeError	Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
00:49:11 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	Unhealthy	Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
00:49:12 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	Unhealthy	Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
00:49:12 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	ProbeError	Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
00:49:41	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	AddedInterface	Add eth0 [10.134.0.93/23] from ovn-kubernetes
00:49:41	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulDelete	Deleted pod: e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6
00:49:41	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj
00:49:41	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf
00:49:41	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cnrg6	Killing	Stopping container istio-proxy
00:49:42	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks
00:49:42	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	Created	Container created
00:49:42	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9
00:49:42	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:42	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	AddedInterface	Add eth0 [10.133.0.61/23] from ovn-kubernetes
00:49:42	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	Started	Container started
00:49:42	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
00:49:42	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:42	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	Created	Container created
00:49:42	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	Started	Container started
00:49:42	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 2 to 4
00:49:43	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	Started	Container started
00:49:43	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	Created	Container created
00:49:43	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:43	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	AddedInterface	Add eth0 [10.132.0.99/23] from ovn-kubernetes
00:49:43	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	AddedInterface	Add eth0 [10.132.0.100/23] from ovn-kubernetes
00:49:43	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	Created	Container created
00:49:43	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	Started	Container started
00:49:43	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:48 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	Unhealthy	Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
00:49:48 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	ProbeError	Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
00:49:49	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g
00:49:49	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz
00:49:49	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w1-552952-openshift-default-855478bdc from 6 to 10
00:49:49	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 10; reason: cpu resource utilization (percentage of request) above target
00:49:49 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	ProbeError	Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
00:49:49 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	Unhealthy	Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
00:49:49	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	(combined from similar events): Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc
00:49:49	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	Created	Container created
00:49:50	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	AddedInterface	Add eth0 [10.132.0.101/23] from ovn-kubernetes
00:49:50	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	AddedInterface	Add eth0 [10.134.0.97/23] from ovn-kubernetes
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	Started	Container started
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:50	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	AddedInterface	Add eth0 [10.133.0.63/23] from ovn-kubernetes
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	Created	Container created
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	Started	Container started
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	Started	Container started
00:49:50	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	AddedInterface	Add eth0 [10.134.0.96/23] from ovn-kubernetes
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	Created	Container created
00:49:50	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:51 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	ProbeError	Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
00:49:51 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	Unhealthy	Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
00:49:51 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	Unhealthy	Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
00:49:51	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	Created	Container created
00:49:51 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	ProbeError	Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
00:49:51	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	Started	Container started
00:49:56	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	Killing	Stopping container istio-proxy
00:49:56	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulDelete	Deleted pod: e2e-worker-w0-902076-openshift-default-d75675f49-mprgk
00:49:57 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	ProbeError	Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
00:49:57 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	ProbeError	Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
00:49:57 (x7)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	Unhealthy	Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
00:49:57 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	Unhealthy	Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
00:49:57 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	Unhealthy	Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
00:49:57 (x7)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	ProbeError	Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
00:49:57 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	ProbeError	Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
00:49:57 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	Unhealthy	Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
00:50:00	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:50:00	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-mprgk	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:50:05	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j
00:50:05	openshift-ingress	gateway_labeler_controller	e2e-mt-ef1f397c	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ef1f397c
00:50:05	openshift-ingress	deployment-controller	e2e-mt-ef1f397c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-ef1f397c-openshift-default-685bdc4857 from 0 to 1
00:50:06	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	AddedInterface	Add eth0 [10.132.0.102/23] from ovn-kubernetes
00:50:10	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Unhealthy	Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:50:10	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	ProbeError	Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:50:10	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	Unhealthy	Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:50:10	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	ProbeError	Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:50:10	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	ProbeError	Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:50:10	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Unhealthy	Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:50:11	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-ef1f397c namespace
00:50:11	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	ProbeError	Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:50:11	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	Unhealthy	Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:50:11	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-55a91c2d namespace
00:50:11	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulDelete	Deleted pod: e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t
00:50:12	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	Killing	Stopping container istio-proxy
00:50:12	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	Unhealthy	Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:50:12	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	ProbeError	Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:50:12	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	ProbeError	Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:50:12	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	Unhealthy	Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:50:13	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-0b831292 namespace
00:50:15	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:50:15	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-cfj8t	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:50:15	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck
00:50:15	openshift-ingress	deployment-controller	payload-processing-e2e-mt-ef1f397c	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-mt-ef1f397c-696fb75475 from 0 to 1
00:50:15	openshift-ingress	deployment-controller	payload-pre-processing-e2e-mt-ef1f397c	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-mt-ef1f397c-56459cb94c from 0 to 1
00:50:15 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef1f397c: serviceaccount "payload-processing-e2e-mt-ef1f397c" not found
00:50:15	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-ef1f397c-696fb75475	SuccessfulCreate	Created pod: payload-processing-e2e-mt-ef1f397c-696fb75475-thz58
00:50:15 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-ef1f397c-696fb75475	FailedCreate	Error creating: pods "payload-processing-e2e-mt-ef1f397c-696fb75475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef1f397c: serviceaccount "payload-processing-e2e-mt-ef1f397c" not found
00:50:16	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-thz58	Started	Container started
00:50:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck	Started	Container started
00:50:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck	Created	Container created
00:50:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:50:16	openshift-insights	job-controller	periodic-gathering-fm2r2	Completed	Job completed
00:50:16	openshift-ingress	multus	payload-processing-e2e-mt-ef1f397c-696fb75475-thz58	AddedInterface	Add eth0 [10.134.0.102/23] from ovn-kubernetes
00:50:16	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-thz58	Created	Container created
00:50:16	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-thz58	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:50:16	openshift-ingress	multus	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck	AddedInterface	Add eth0 [10.134.0.101/23] from ovn-kubernetes
00:50:28	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 4 to 8
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	Started	Container started
00:50:28	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	AddedInterface	Add eth0 [10.132.0.103/23] from ovn-kubernetes
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:50:28	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	AddedInterface	Add eth0 [10.133.0.67/23] from ovn-kubernetes
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	Created	Container created
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	Started	Container started
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	Created	Container created
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	Started	Container started
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	Created	Container created
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:50:28	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	AddedInterface	Add eth0 [10.134.0.104/23] from ovn-kubernetes
00:50:28	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	AddedInterface	Add eth0 [10.134.0.103/23] from ovn-kubernetes
00:50:28	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:50:28	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w
00:50:28	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n
00:50:28	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb
00:50:28	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs
00:50:29	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	Created	Container created
00:50:29	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	Started	Container started
00:50:35	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7ddd9cfdc8	SuccessfulCreate	Created pod: istiod-openshift-gateway-7ddd9cfdc8-g8m28
00:50:36 (x8)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	Unhealthy	Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
00:50:36 (x8)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	ProbeError	Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
00:50:36 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	ProbeError	Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
00:50:36 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	Unhealthy	Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
00:50:36 (x8)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	Unhealthy	Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
00:50:36 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	Unhealthy	Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
00:50:36 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	ProbeError	Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
00:50:36 (x8)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	ProbeError	Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
00:50:37	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-g8m28	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
00:50:37	openshift-ingress	multus	istiod-openshift-gateway-7ddd9cfdc8-g8m28	AddedInterface	Add eth0 [10.132.0.104/23] from ovn-kubernetes
00:50:38	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	Unhealthy	Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:50:38	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	ProbeError	Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:50:42	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-g8m28	Created	Container created
00:50:42	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-g8m28	Started	Container started
00:50:42	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-g8m28	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.716s (4.716s including waiting). Image size: 185476477 bytes.
00:50:43	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-g8m28	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:50:43	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	AddedInterface	Add eth0 [10.133.0.68/23] from ovn-kubernetes
00:50:43	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp
00:50:43	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 8 to 9
00:50:43	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 9; reason: All metrics below target
00:50:43	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-g8m28	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:50:44	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	Started	Container started
00:50:44	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	Created	Container created
00:50:44	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:50:45	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-f926c557 namespace
00:50:50 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	Unhealthy	Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
00:50:50 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	ProbeError	Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
00:50:58	openshift-ingress	replicaset-controller	e2e-api-a-f7f61b-openshift-default-6b568b58b9	SuccessfulCreate	Created pod: e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4
00:50:58	openshift-ingress	deployment-controller	e2e-api-a-f7f61b-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-f7f61b-openshift-default-6b568b58b9 from 0 to 1
00:50:58	openshift-ingress	gateway_labeler_controller	e2e-api-a-f7f61b	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f7f61b
00:51:00	openshift-ingress	multus	e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	AddedInterface	Add eth0 [10.134.0.106/23] from ovn-kubernetes
00:51:02 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	Unhealthy	Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:51:02 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	ProbeError	Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:51:04	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-a-f7f61b namespace
00:51:07	openshift-ingress	deployment-controller	payload-processing-e2e-api-a-f7f61b	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-a-f7f61b-7d5bb5679f from 0 to 1
00:51:08	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-f7f61b-7d5bb5679f	SuccessfulCreate	Created pod: payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw
00:51:08 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-f7f61b-7d5bb5679f	FailedCreate	Error creating: pods "payload-processing-e2e-api-a-f7f61b-7d5bb5679f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f7f61b: serviceaccount "payload-processing-e2e-api-a-f7f61b" not found
00:51:08 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f7f61b: serviceaccount "payload-processing-e2e-api-a-f7f61b" not found
00:51:08	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q
00:51:08	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-a-f7f61b	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f from 0 to 1
00:51:09	openshift-ingress	multus	payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw	AddedInterface	Add eth0 [10.134.0.107/23] from ovn-kubernetes
00:51:09	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q	Created	Container created
00:51:09	openshift-ingress	kubelet	payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw	Started	Container started
00:51:09	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q	Started	Container started
00:51:09	openshift-ingress	kubelet	payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw	Created	Container created
00:51:09	openshift-ingress	kubelet	payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:51:09 (x2)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:51:09	openshift-ingress	multus	payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q	AddedInterface	Add eth0 [10.134.0.108/23] from ovn-kubernetes
00:51:09	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:51:09	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Unhealthy	Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": read tcp 10.132.0.2:56838->10.132.0.102:15021: read: connection reset by peer
00:51:09	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	ProbeError	Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": read tcp 10.132.0.2:56838->10.132.0.102:15021: read: connection reset by peer body:
00:51:09 (x2)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Started	Container started
00:51:09 (x2)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Created	Container created
00:51:13	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 9 to 10
00:51:13	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	(combined from similar events): Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb
00:51:14	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	AddedInterface	Add eth0 [10.133.0.70/23] from ovn-kubernetes
00:51:14	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	Started	Container started
00:51:14	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	Created	Container created
00:51:14	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:51:15 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	ProbeError	Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
00:51:15 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Unhealthy	Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
00:51:20 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	Unhealthy	Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
00:51:20 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	ProbeError	Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
00:51:21 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-ef1f397c-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:51:21 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-ef1f397c-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:51:42	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf
00:51:43	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	Created	Container created
00:51:43	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:51:43	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	AddedInterface	Add eth0 [10.134.0.109/23] from ovn-kubernetes
00:51:43	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	Started	Container started
00:51:50 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	ProbeError	Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
00:51:50 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	Unhealthy	Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
00:51:51 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-ef1f397c-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:51:51 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-ef1f397c-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:52:21 (x2)	openshift-ingress	kubelet	e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:52:21 (x2)	openshift-ingress	kubelet	e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	Created	Container created
00:52:21 (x2)	openshift-ingress	kubelet	e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	Started	Container started
00:52:27 (x6)	openshift-ingress	kubelet	e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	ProbeError	Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:
00:52:27 (x6)	openshift-ingress	kubelet	e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	Unhealthy	Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
00:52:29 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-f7f61b-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:52:29 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-f7f61b-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:52:32	openshift-ingress	deployment-controller	e2e-api-b-4a6e81-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-4a6e81-openshift-default-747df9c7c from 0 to 1
00:52:32	openshift-ingress	replicaset-controller	e2e-api-b-4a6e81-openshift-default-747df9c7c	SuccessfulCreate	Created pod: e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr
00:52:32	openshift-ingress	gateway_labeler_controller	e2e-api-b-4a6e81	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4a6e81
00:52:33	openshift-ingress	multus	e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	AddedInterface	Add eth0 [10.134.0.111/23] from ovn-kubernetes
00:52:37	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-b-4a6e81 namespace
00:52:40	openshift-ingress	deployment-controller	payload-processing-e2e-api-b-4a6e81	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-b-4a6e81-5b6f88ff47 from 0 to 1
00:52:41	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-b-4a6e81	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf from 0 to 1
00:52:41	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v
00:52:41 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-4a6e81-5b6f88ff47	FailedCreate	Error creating: pods "payload-processing-e2e-api-b-4a6e81-5b6f88ff47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4a6e81: serviceaccount "payload-processing-e2e-api-b-4a6e81" not found
00:52:41	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-4a6e81-5b6f88ff47	SuccessfulCreate	Created pod: payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2
00:52:41 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4a6e81: serviceaccount "payload-processing-e2e-api-b-4a6e81" not found
00:52:42	openshift-ingress	kubelet	payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2	Created	Container created
00:52:42	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v	Started	Container started
00:52:42	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:52:42	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v	Created	Container created
00:52:42	openshift-ingress	kubelet	payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2	Started	Container started
00:52:42	openshift-ingress	kubelet	payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:52:42	openshift-ingress	multus	payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2	AddedInterface	Add eth0 [10.132.0.106/23] from ovn-kubernetes
00:52:42	openshift-ingress	multus	payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v	AddedInterface	Add eth0 [10.132.0.105/23] from ovn-kubernetes
00:52:49	openshift-ingress	replicaset-controller	e2e-api-a-c5ead3-openshift-default-5b69779d99	SuccessfulCreate	Created pod: e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd
00:52:49	openshift-ingress	deployment-controller	e2e-api-a-c5ead3-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-c5ead3-openshift-default-5b69779d99 from 0 to 1
00:52:49	openshift-ingress	gateway_labeler_controller	e2e-api-a-c5ead3	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c5ead3
00:52:50	openshift-ingress	multus	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	AddedInterface	Add eth0 [10.133.0.75/23] from ovn-kubernetes
00:52:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-a-c5ead3 namespace
00:52:56	openshift-ingress	deployment-controller	payload-processing-e2e-api-a-c5ead3	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-a-c5ead3-b9fdbbd9 from 0 to 1
00:52:57 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5ead3: serviceaccount "payload-processing-e2e-api-a-c5ead3" not found
00:52:57 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-c5ead3-b9fdbbd9	FailedCreate	Error creating: pods "payload-processing-e2e-api-a-c5ead3-b9fdbbd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5ead3: serviceaccount "payload-processing-e2e-api-a-c5ead3" not found
00:52:57	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-c5ead3-b9fdbbd9	SuccessfulCreate	Created pod: payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc
00:52:57	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl
00:52:57	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-a-c5ead3	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c from 0 to 1
00:52:58	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:52:58	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl	Started	Container started
00:52:58	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl	Created	Container created
00:52:58	openshift-ingress	multus	payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl	AddedInterface	Add eth0 [10.134.0.112/23] from ovn-kubernetes
00:52:58	openshift-ingress	multus	payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc	AddedInterface	Add eth0 [10.134.0.113/23] from ovn-kubernetes
00:52:58	openshift-ingress	kubelet	payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:52:58	openshift-ingress	kubelet	payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc	Created	Container created
00:52:58	openshift-ingress	kubelet	payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc	Started	Container started
00:52:59 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-f7f61b-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:52:59 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-f7f61b-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:53:13	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	AddedInterface	Add eth0 [10.133.0.76/23] from ovn-kubernetes
00:53:13	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 2 to 4
00:53:13	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	AddedInterface	Add eth0 [10.132.0.107/23] from ovn-kubernetes
00:53:13	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4
00:53:13 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
00:53:13	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6
00:53:14	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:53:14	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	Created	Container created
00:53:14	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:53:14	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	Started	Container started
00:53:14	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	Created	Container created
00:53:14	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	Started	Container started
00:53:20 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	ProbeError	Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
00:53:20 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	ProbeError	Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
00:53:20 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	Unhealthy	Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
00:53:20 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	Unhealthy	Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
00:53:27	opendatahub	multus	test-curl-7460-3512d7	AddedInterface	Add eth0 [10.134.0.114/23] from ovn-kubernetes
00:53:27	opendatahub	kubelet	test-curl-7460-3512d7	Pulling	Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
00:53:30	opendatahub	kubelet	test-curl-7460-3512d7	Started	Container started
00:53:30	opendatahub	kubelet	test-curl-7460-3512d7	Pulled	Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.647s (2.647s including waiting). Image size: 106100986 bytes.
00:53:30	opendatahub	kubelet	test-curl-7460-3512d7	Created	Container created
00:53:33	opendatahub	kubelet	test-curl-7460-3512d7	Killing	Stopping container test-curl-7460-3512d7
00:53:37	openshift-ingress	replicaset-controller	e2e-api-a-38d3a2-openshift-default-86c5544c5f	SuccessfulCreate	Created pod: e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw
00:53:37	openshift-ingress	deployment-controller	e2e-api-a-38d3a2-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-38d3a2-openshift-default-86c5544c5f from 0 to 1
00:53:37	openshift-ingress	gateway_labeler_controller	e2e-api-a-38d3a2	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-38d3a2
00:53:38	openshift-ingress	multus	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	AddedInterface	Add eth0 [10.134.0.115/23] from ovn-kubernetes
00:53:42	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-a-38d3a2 namespace
00:53:44	openshift-ingress	multus	e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	AddedInterface	Add eth0 [10.133.0.79/23] from ovn-kubernetes
00:53:44	openshift-ingress	deployment-controller	e2e-api-a-dce655-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-dce655-openshift-default-676dcd9985 from 0 to 1
00:53:44	openshift-ingress	gateway_labeler_controller	e2e-api-a-dce655	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dce655
00:53:44	openshift-ingress	replicaset-controller	e2e-api-a-dce655-openshift-default-676dcd9985	SuccessfulCreate	Created pod: e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj
00:53:45 (x2)	openshift-ingress	kubelet	e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:53:45 (x2)	openshift-ingress	kubelet	e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	Started	Container started
00:53:45 (x2)	openshift-ingress	kubelet	e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	Created	Container created
00:53:46 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-38d3a2: serviceaccount "payload-processing-e2e-api-a-38d3a2" not found
00:53:46	openshift-ingress	deployment-controller	payload-processing-e2e-api-a-38d3a2	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-a-38d3a2-849966c4df from 0 to 1
00:53:46	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b
00:53:46	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-a-38d3a2	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc from 0 to 1
00:53:46 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-38d3a2-849966c4df	FailedCreate	Error creating: pods "payload-processing-e2e-api-a-38d3a2-849966c4df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-38d3a2: serviceaccount "payload-processing-e2e-api-a-38d3a2" not found
00:53:47	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-38d3a2-849966c4df	SuccessfulCreate	Created pod: payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n
00:53:47	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck	Killing	Stopping container payload-pre-processing
00:53:47	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-thz58	Killing	Stopping container payload-processing
00:53:48	openshift-ingress	kubelet	payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:53:48	openshift-ingress	kubelet	payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n	Started	Container started
00:53:48	openshift-ingress	kubelet	payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n	Created	Container created
00:53:48	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-a-dce655 namespace
00:53:48 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-4a6e81-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:53:48	openshift-ingress	multus	payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b	AddedInterface	Add eth0 [10.134.0.116/23] from ovn-kubernetes
00:53:48	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:53:48	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b	Created	Container created
00:53:48	openshift-ingress	multus	payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n	AddedInterface	Add eth0 [10.134.0.117/23] from ovn-kubernetes
00:53:48 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-4a6e81-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:53:48	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b	Started	Container started
00:53:51 (x4)	openshift-ingress	kubelet	e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	ProbeError	Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:
00:53:51 (x4)	openshift-ingress	kubelet	e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	Unhealthy	Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused
00:53:53	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-a-dce655	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-a-dce655-5ddc9f875 from 0 to 1
00:53:53 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-dce655-d997fcc5f	FailedCreate	Error creating: pods "payload-processing-e2e-api-a-dce655-d997fcc5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dce655: serviceaccount "payload-processing-e2e-api-a-dce655" not found
00:53:53 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-dce655-5ddc9f875	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-a-dce655-5ddc9f875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dce655: serviceaccount "payload-processing-e2e-api-a-dce655" not found
00:53:53	openshift-ingress	deployment-controller	payload-processing-e2e-api-a-dce655	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-a-dce655-d997fcc5f from 0 to 1
00:53:54	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-dce655-5ddc9f875	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd
00:53:54	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-dce655-d997fcc5f	SuccessfulCreate	Created pod: payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76
00:53:55	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd	Started	Container started
00:53:55	openshift-ingress	multus	payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd	AddedInterface	Add eth0 [10.134.0.118/23] from ovn-kubernetes
00:53:55	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:53:55	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd	Created	Container created
00:53:55	openshift-ingress	multus	payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76	AddedInterface	Add eth0 [10.134.0.119/23] from ovn-kubernetes
00:53:55	openshift-ingress	kubelet	payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:53:55	openshift-ingress	kubelet	payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76	Created	Container created
00:53:55	openshift-ingress	kubelet	payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76	Started	Container started
00:54:07 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-2qzck	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
00:54:07 (x2)	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-thz58	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
00:54:11 (x2)	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	Created	Container created
00:54:11 (x2)	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:54:11 (x2)	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	Started	Container started
00:54:17 (x5)	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	Unhealthy	Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
00:54:17 (x5)	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	ProbeError	Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
00:54:18 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-4a6e81-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:54:18 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-4a6e81-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:54:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-c5ead3-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:54:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-c5ead3-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:54:28	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-f7f61b-66f6969f5f-jtc2q	Killing	Stopping container payload-pre-processing
00:54:28	openshift-ingress	kubelet	payload-processing-e2e-api-a-f7f61b-7d5bb5679f-tfblw	Killing	Stopping container payload-processing
00:54:37	openshift-ingress	gateway_labeler_controller	e2e-api-b-2815b2	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2815b2
00:54:37	openshift-ingress	deployment-controller	e2e-api-b-2815b2-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-2815b2-openshift-default-66bb48bf9f from 0 to 1
00:54:37	openshift-ingress	replicaset-controller	e2e-api-b-2815b2-openshift-default-66bb48bf9f	SuccessfulCreate	Created pod: e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7
00:54:38	openshift-ingress	multus	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	AddedInterface	Add eth0 [10.134.0.120/23] from ovn-kubernetes
00:54:43	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj
00:54:43	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-b-2815b2 namespace
00:54:43	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rt9mj	Killing	Stopping container istio-proxy
00:54:46	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-2815b2-7f5789654f	SuccessfulCreate	Created pod: payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2
00:54:46 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-2815b2-7f5789654f	FailedCreate	Error creating: pods "payload-processing-e2e-api-b-2815b2-7f5789654f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2815b2: serviceaccount "payload-processing-e2e-api-b-2815b2" not found
00:54:46	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-b-2815b2	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47 from 0 to 1
00:54:46 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2815b2: serviceaccount "payload-processing-e2e-api-b-2815b2" not found
00:54:46	openshift-ingress	deployment-controller	payload-processing-e2e-api-b-2815b2	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-b-2815b2-7f5789654f from 0 to 1
00:54:46	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2
00:54:47	openshift-ingress	kubelet	payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2	Created	Container created
00:54:47	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:54:47	openshift-ingress	kubelet	payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2	Started	Container started
00:54:47	openshift-ingress	multus	payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2	AddedInterface	Add eth0 [10.134.0.121/23] from ovn-kubernetes
00:54:47	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2	Created	Container created
00:54:47	openshift-ingress	kubelet	payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:54:47	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2	Started	Container started
00:54:47	openshift-ingress	multus	payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2	AddedInterface	Add eth0 [10.134.0.122/23] from ovn-kubernetes
00:54:50 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-c5ead3-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:54:50 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-c5ead3-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:54:52	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-2815b2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:54:52	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-2815b2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:54:58	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf	Killing	Stopping container istio-proxy
00:54:58	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-dnbbf
00:55:00	openshift-ingress	kubelet	e2e-api-a-f7f61b-openshift-default-6b568b58b9-lbqf4	Killing	Stopping container istio-proxy
00:55:08	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-4a6e81-5864f57ccf-5tt7v	Killing	Stopping container payload-pre-processing
00:55:08	openshift-ingress	kubelet	payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2	Killing	Stopping container payload-processing
00:55:14 (x2)	openshift-ingress	kubelet	e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	Created	Container created
00:55:14 (x2)	openshift-ingress	kubelet	e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:55:14	openshift-ingress	kubelet	payload-processing-e2e-api-b-4a6e81-5b6f88ff47-n2cg2	Unhealthy	Readiness probe failed: timeout: failed to connect service "10.132.0.106:50052" within 1s: context deadline exceeded
00:55:14 (x2)	openshift-ingress	kubelet	e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	Started	Container started
00:55:15 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-dce655-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:55:15 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-dce655-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:55:19 (x5)	openshift-ingress	kubelet	e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	ProbeError	Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
00:55:19 (x5)	openshift-ingress	kubelet	e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	Unhealthy	Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
00:55:20	openshift-ingress	deployment-controller	payload-pre-processing-e2e-mt-ef1f397c	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-mt-ef1f397c-56459cb94c from 0 to 1
00:55:20	openshift-ingress	deployment-controller	payload-processing-e2e-mt-ef1f397c	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-mt-ef1f397c-696fb75475 from 0 to 1
00:55:21 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-ef1f397c-696fb75475	FailedCreate	Error creating: pods "payload-processing-e2e-mt-ef1f397c-696fb75475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef1f397c: serviceaccount "payload-processing-e2e-mt-ef1f397c" not found
00:55:21 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef1f397c: serviceaccount "payload-processing-e2e-mt-ef1f397c" not found
00:55:21	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-ef1f397c-696fb75475	SuccessfulCreate	Created pod: payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw
00:55:21	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr
00:55:22	openshift-ingress	multus	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr	AddedInterface	Add eth0 [10.134.0.123/23] from ovn-kubernetes
00:55:22	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr	Started	Container started
00:55:22	openshift-ingress	multus	payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw	AddedInterface	Add eth0 [10.134.0.124/23] from ovn-kubernetes
00:55:22	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw	Started	Container started
00:55:22	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw	Created	Container created
00:55:22	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr	Created	Container created
00:55:22	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:55:22	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:55:34	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56
00:55:34	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb
00:55:34	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	Killing	Stopping container istio-proxy
00:55:34	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 8; reason: All metrics below target
00:55:34	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-6fx56	Killing	Stopping container istio-proxy
00:55:34	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 10 to 8
00:55:36	openshift-ingress	gateway_labeler_controller	e2e-api-b-9496d3	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9496d3
00:55:36	openshift-ingress	deployment-controller	e2e-api-b-9496d3-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-9496d3-openshift-default-55dccf9597 from 0 to 1
00:55:36	openshift-ingress	replicaset-controller	e2e-api-b-9496d3-openshift-default-55dccf9597	SuccessfulCreate	Created pod: e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46
00:55:37	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc
00:55:37	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz	Killing	Stopping container istio-proxy
00:55:37	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	Killing	Stopping container istio-proxy
00:55:37	openshift-ingress	multus	e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	AddedInterface	Add eth0 [10.134.0.125/23] from ovn-kubernetes
00:55:37	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 8; reason: All metrics below target
00:55:37	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w1-552952-openshift-default-855478bdc from 10 to 8
00:55:37	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-lmmvz
00:55:38	openshift-ingress	replicaset-controller	e2e-api-a-38d3a2-openshift-default-86c5544c5f	SuccessfulCreate	Created pod: e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc
00:55:38	openshift-ingress	replicaset-controller	e2e-api-a-38d3a2-openshift-default-86c5544c5f	SuccessfulCreate	Created pod: e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf
00:55:38	openshift-ingress	replicaset-controller	e2e-api-a-38d3a2-openshift-default-86c5544c5f	SuccessfulCreate	Created pod: e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb
00:55:38	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-38d3a2-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
00:55:38	openshift-ingress	deployment-controller	e2e-api-a-38d3a2-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-38d3a2-openshift-default-86c5544c5f from 1 to 4
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	Created	Container created
00:55:39	openshift-ingress	multus	e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	AddedInterface	Add eth0 [10.133.0.82/23] from ovn-kubernetes
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	Created	Container created
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	Started	Container started
00:55:39	openshift-ingress	multus	e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	AddedInterface	Add eth0 [10.132.0.111/23] from ovn-kubernetes
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	Created	Container created
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	Started	Container started
00:55:39	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:55:39	openshift-ingress	multus	e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	AddedInterface	Add eth0 [10.134.0.126/23] from ovn-kubernetes
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:55:39	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5dxtb	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:55:39	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	Started	Container started
00:55:40	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	ProbeError	Readiness probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
00:55:40 (x2)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:55:40	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Unhealthy	Readiness probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
00:55:41 (x2)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Created	Container created
00:55:41 (x2)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Started	Container started
00:55:42	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-b-9496d3 namespace
00:55:43	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	Unhealthy	Readiness probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
00:55:43	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-kvrlc	ProbeError	Readiness probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
00:55:44 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	ProbeError	Startup probe error: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused body:
00:55:44 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	Unhealthy	Startup probe failed: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused
00:55:44 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	ProbeError	Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
00:55:44 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	Unhealthy	Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
00:55:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-dce655-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:55:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-dce655-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:55:45 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	ProbeError	Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
00:55:45 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	Unhealthy	Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
00:55:46 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Unhealthy	Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
00:55:46 (x5)	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	ProbeError	Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
00:55:47	openshift-ingress	deployment-controller	e2e-api-b-ee0d47-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-ee0d47-openshift-default-5b96858985 from 0 to 1
00:55:47	openshift-ingress	gateway_labeler_controller	e2e-api-b-ee0d47	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ee0d47
00:55:47	openshift-ingress	replicaset-controller	e2e-api-b-ee0d47-openshift-default-5b96858985	SuccessfulCreate	Created pod: e2e-api-b-ee0d47-openshift-default-5b96858985-n284q
00:55:48	openshift-ingress	deployment-controller	payload-processing-e2e-api-b-9496d3	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-b-9496d3-bc54d89b7 from 0 to 1
00:55:48	openshift-ingress	multus	e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	AddedInterface	Add eth0 [10.134.0.128/23] from ovn-kubernetes
00:55:49 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9496d3: serviceaccount "payload-processing-e2e-api-b-9496d3" not found
00:55:49	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-b-9496d3	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55 from 0 to 1
00:55:49	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c
00:55:49	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs	Killing	Stopping container istio-proxy
00:55:49 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-9496d3-bc54d89b7	FailedCreate	Error creating: pods "payload-processing-e2e-api-b-9496d3-bc54d89b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9496d3: serviceaccount "payload-processing-e2e-api-b-9496d3" not found
00:55:49	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Killing	Stopping container istio-proxy
00:55:49	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m
00:55:49	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 4; reason: All metrics below target
00:55:49	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-9496d3-bc54d89b7	SuccessfulCreate	Created pod: payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9
00:55:49	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-9h6qs
00:55:49	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	Killing	Stopping container istio-proxy
00:55:49	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 8 to 4
00:55:49	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n
00:55:49	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq
00:55:49	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-2s89n	Killing	Stopping container istio-proxy
00:55:50	openshift-ingress	multus	payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq	AddedInterface	Add eth0 [10.134.0.129/23] from ovn-kubernetes
00:55:50	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq	Started	Container started
00:55:50	openshift-ingress	kubelet	payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9	Created	Container created
00:55:50	openshift-ingress	kubelet	payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:55:50	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:55:50	openshift-ingress	kubelet	payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9	Started	Container started
00:55:50	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq	Created	Container created
00:55:50	openshift-ingress	multus	payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9	AddedInterface	Add eth0 [10.134.0.130/23] from ovn-kubernetes
00:55:52	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-b-ee0d47 namespace
00:55:52	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv
00:55:52	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-ntfrv	Killing	Stopping container istio-proxy
00:55:52	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 7; reason: All metrics below target
00:55:52	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w1-552952-openshift-default-855478bdc from 8 to 7
00:55:53 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-38d3a2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:55:53 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-38d3a2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:55:54	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:55:54	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:55:54	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-5xr7c	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:55:54	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-nch2m	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:55:58	openshift-ingress	deployment-controller	payload-processing-e2e-api-b-ee0d47	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-b-ee0d47-7568758575 from 0 to 1
00:55:58 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-ee0d47-7568758575	FailedCreate	Error creating: pods "payload-processing-e2e-api-b-ee0d47-7568758575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ee0d47: serviceaccount "payload-processing-e2e-api-b-ee0d47" not found
00:55:58 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-ee0d47-79f75964dc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ee0d47: serviceaccount "payload-processing-e2e-api-b-ee0d47" not found
00:55:58	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-ee0d47-79f75964dc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx
00:55:58	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-b-ee0d47	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-b-ee0d47-79f75964dc from 0 to 1
00:55:59	openshift-ingress	multus	payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt	AddedInterface	Add eth0 [10.134.0.132/23] from ovn-kubernetes
00:55:59	openshift-ingress	multus	payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx	AddedInterface	Add eth0 [10.134.0.131/23] from ovn-kubernetes
00:55:59	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:55:59	openshift-ingress	kubelet	payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:55:59	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-ee0d47-7568758575	SuccessfulCreate	Created pod: payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt
00:56:00	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx	Created	Container created
00:56:00	openshift-ingress	kubelet	payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt	Created	Container created
00:56:00	openshift-ingress	kubelet	payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt	Started	Container started
00:56:00	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx	Started	Container started
00:56:07	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	Killing	Stopping container istio-proxy
00:56:07	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w1-552952-openshift-default-855478bdc from 7 to 5
00:56:07	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 5; reason: All metrics below target
00:56:07	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g	Killing	Stopping container istio-proxy
00:56:07	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c
00:56:07	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-v8b7g
00:56:08	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-38d3a2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:56:08	openshift-ingress	kubelet	e2e-api-b-4a6e81-openshift-default-747df9c7c-4h5sr	Killing	Stopping container istio-proxy
00:56:08	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-38d3a2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:56:12	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:56:12	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-nvb4c	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:56:22 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9496d3-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:56:22 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9496d3-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:56:23	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	Killing	Stopping container istio-proxy
00:56:23	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 4; reason: All metrics below target
00:56:23	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7
00:56:23	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w1-552952-openshift-default-855478bdc from 5 to 4
00:56:28	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	Unhealthy	Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": read tcp 10.132.0.2:55962->10.132.0.98:15021: read: connection reset by peer
00:56:28	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-pfdf7	ProbeError	Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": read tcp 10.132.0.2:55962->10.132.0.98:15021: read: connection reset by peer body:
00:56:38	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-ef1f397c-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	Started	Container started
00:56:39	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	AddedInterface	Add eth0 [10.134.0.134/23] from ovn-kubernetes
00:56:39	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	AddedInterface	Add eth0 [10.133.0.84/23] from ovn-kubernetes
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	Started	Container started
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	Created	Container created
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	Started	Container started
00:56:39	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f
00:56:39	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k
00:56:39	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	Created	Container created
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:56:39	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	AddedInterface	Add eth0 [10.134.0.135/23] from ovn-kubernetes
00:56:39	openshift-ingress	deployment-controller	e2e-mt-ef1f397c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-ef1f397c-openshift-default-685bdc4857 from 1 to 4
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	Created	Container created
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:56:39	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:56:45	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Killing	Stopping container istio-proxy
00:56:45	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9	Killing	Stopping container istio-proxy
00:56:45	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs	Killing	Stopping container istio-proxy
00:56:45 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	Unhealthy	Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused
00:56:45	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks	Killing	Stopping container istio-proxy
00:56:45 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	Unhealthy	Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused
00:56:45	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp
00:56:45 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	Unhealthy	Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
00:56:45 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	ProbeError	Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
00:56:45	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 10 to 4
00:56:45	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-bs7n9
00:56:45	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb
00:56:45	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp
00:56:45 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	ProbeError	Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
00:56:45	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-xsbpb	Killing	Stopping container istio-proxy
00:56:45	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-8btgs
00:56:45	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-r5dtp	Killing	Stopping container istio-proxy
00:56:45	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-5tfks
00:56:45 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	ProbeError	Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:
00:56:49	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:56:49	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-vjjcp	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:56:54	openshift-ingress	deployment-controller	e2e-mt-ef1f397c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-ef1f397c-openshift-default-685bdc4857 from 4 to 8
00:56:54	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x
00:56:54	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj
00:56:54	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk
00:56:54	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88
00:56:54	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-ef1f397c-openshift-default	SuccessfulRescale	New size: 8; reason:
00:56:55	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:56:55	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	Started	Container started
00:56:55	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:56:55	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	AddedInterface	Add eth0 [10.133.0.86/23] from ovn-kubernetes
00:56:55	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	Created	Container created
00:56:55	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	AddedInterface	Add eth0 [10.132.0.113/23] from ovn-kubernetes
00:56:55	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	AddedInterface	Add eth0 [10.133.0.87/23] from ovn-kubernetes
00:56:55	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:56:55	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	Started	Container started
00:56:55	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	Created	Container created
00:56:56	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	Started	Container started
00:56:56	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:56:56	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	Started	Container started
00:56:56	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	Created	Container created
00:56:56	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	AddedInterface	Add eth0 [10.134.0.136/23] from ovn-kubernetes
00:56:56	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	Created	Container created
00:56:57	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	Unhealthy	Readiness probe failed: Get "http://10.134.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
00:56:57	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	ProbeError	Readiness probe error: Get "http://10.134.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
00:57:01 (x2)	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	Started	Container started
00:57:01 (x6)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	ProbeError	Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
00:57:01 (x6)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	Unhealthy	Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
00:57:01	openshift-ingress	kubelet	payload-processing-e2e-api-a-c5ead3-b9fdbbd9-5fvhc	Killing	Stopping container payload-processing
00:57:01	openshift-ingress	deployment-controller	e2e-ipp-a-265a7f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-a-265a7f-openshift-default-6648c84f49 from 0 to 1
00:57:01	openshift-ingress	replicaset-controller	e2e-ipp-a-265a7f-openshift-default-6648c84f49	SuccessfulCreate	Created pod: e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5
00:57:01 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	Unhealthy	Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
00:57:01	openshift-ingress	gateway_labeler_controller	e2e-ipp-a-265a7f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-265a7f
00:57:01 (x2)	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	Created	Container created
00:57:01 (x6)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	Unhealthy	Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
00:57:01 (x2)	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:57:01 (x6)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	ProbeError	Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
00:57:01 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	ProbeError	Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
00:57:02	openshift-ingress	multus	e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	AddedInterface	Add eth0 [10.133.0.88/23] from ovn-kubernetes
00:57:02	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-c5ead3-69bc7c4f6c-pr7vl	Killing	Stopping container payload-pre-processing
00:57:03 (x7)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	Unhealthy	Startup probe failed: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused
00:57:03 (x7)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	ProbeError	Startup probe error: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused body:
00:57:05 (x2)	openshift-ingress	kubelet	e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	Started	Container started
00:57:05 (x2)	openshift-ingress	kubelet	e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:57:05 (x2)	openshift-ingress	kubelet	e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	Created	Container created
00:57:06	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-a-265a7f namespace
00:57:08 (x7)	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	ProbeError	Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
00:57:08 (x7)	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	Unhealthy	Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
00:57:09	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-265a7f-864985986c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc
00:57:09	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-265a7f	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-265a7f-5b8666bdcf from 0 to 1
00:57:09 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-265a7f-864985986c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-265a7f-864985986c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-265a7f: serviceaccount "payload-processing-e2e-ipp-a-265a7f" not found
00:57:09	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-265a7f	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-265a7f-864985986c from 0 to 1
00:57:09 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-265a7f-5b8666bdcf	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-265a7f: serviceaccount "payload-processing-e2e-ipp-a-265a7f" not found
00:57:09	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-ef1f397c-openshift-default	SuccessfulRescale	New size: 9; reason:
00:57:09	openshift-ingress	deployment-controller	e2e-mt-ef1f397c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-ef1f397c-openshift-default-685bdc4857 from 8 to 9
00:57:09	openshift-ingress	replicaset-controller	e2e-mt-ef1f397c-openshift-default-685bdc4857	SuccessfulCreate	Created pod: e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw
00:57:10	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-265a7f-5b8666bdcf	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j
00:57:10	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	Started	Container started
00:57:10	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:57:10	openshift-ingress	multus	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	AddedInterface	Add eth0 [10.132.0.114/23] from ovn-kubernetes
00:57:10	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	Created	Container created
00:57:10	openshift-ingress	multus	payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j	AddedInterface	Add eth0 [10.132.0.116/23] from ovn-kubernetes
00:57:10	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc	AddedInterface	Add eth0 [10.132.0.115/23] from ovn-kubernetes
00:57:10	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:57:10	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc	Started	Container started
00:57:10	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc	Created	Container created
00:57:10	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:57:11 (x5)	openshift-ingress	kubelet	e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	ProbeError	Startup probe error: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused body:
00:57:11	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j	Started	Container started
00:57:11 (x5)	openshift-ingress	kubelet	e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	Unhealthy	Startup probe failed: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused
00:57:11	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j	Created	Container created
00:57:15 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	Unhealthy	Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
00:57:15 (x5)	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	ProbeError	Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:
00:57:22 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9496d3-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:57:22 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9496d3-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:57:24	opendatahub	multus	test-curl-7460-7d447c	AddedInterface	Add eth0 [10.133.0.89/23] from ovn-kubernetes
00:57:24	opendatahub	kubelet	test-curl-7460-7d447c	Pulling	Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
00:57:24 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-2815b2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:57:24 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-2815b2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:57:27	opendatahub	kubelet	test-curl-7460-7d447c	Created	Container created
00:57:27	opendatahub	kubelet	test-curl-7460-7d447c	Started	Container started
00:57:27	opendatahub	kubelet	test-curl-7460-7d447c	Pulled	Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.967s (2.967s including waiting). Image size: 106100986 bytes.
00:57:30	opendatahub	kubelet	test-curl-7460-7d447c	Killing	Stopping container test-curl-7460-7d447c
00:57:32	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	Killing	Stopping container istio-proxy
00:57:33	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:57:33	openshift-ingress	kubelet	e2e-api-a-c5ead3-openshift-default-5b69779d99-l9xdd	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:57:34 (x2)	openshift-ingress	kubelet	e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	Started	Container started
00:57:34 (x2)	openshift-ingress	kubelet	e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	Created	Container created
00:57:34 (x2)	openshift-ingress	kubelet	e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:57:39 (x5)	openshift-ingress	kubelet	e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	Unhealthy	Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
00:57:39 (x5)	openshift-ingress	kubelet	e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	ProbeError	Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
00:57:40	openshift-ingress	kubelet	payload-processing-e2e-api-b-2815b2-7f5789654f-w7pt2	Killing	Stopping container payload-processing
00:57:40	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-2815b2-6c99cd9f47-zxlx2	Killing	Stopping container payload-pre-processing
00:57:47 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-265a7f-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:57:47 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-265a7f-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:57:54	openshift-ingress	kubelet	e2e-api-b-2815b2-openshift-default-66bb48bf9f-sg5d7	Killing	Stopping container istio-proxy
00:57:55	openshift-ingress	kubelet	payload-processing-e2e-api-a-38d3a2-849966c4df-rlb7n	Killing	Stopping container payload-processing
00:57:55	openshift-ingress	replicaset-controller	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7	SuccessfulCreate	Created pod: e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4
00:57:55	openshift-ingress	gateway_labeler_controller	e2e-ipp-a-fc694d	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-fc694d
00:57:55	openshift-ingress	deployment-controller	e2e-ipp-a-fc694d-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7 from 0 to 1
00:57:55	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-38d3a2-7fc884b6bc-qgk5b	Killing	Stopping container payload-pre-processing
00:57:56	openshift-ingress	multus	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	AddedInterface	Add eth0 [10.133.0.90/23] from ovn-kubernetes
00:58:01	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-a-fc694d namespace
00:58:03 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-ee0d47-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:58:03 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-ee0d47-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:58:04 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc694d-c77db45d5	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-fc694d-c77db45d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc694d: serviceaccount "payload-processing-e2e-ipp-a-fc694d" not found
00:58:04	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc694d-c77db45d5	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz
00:58:04	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-fc694d	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-fc694d-c77db45d5 from 0 to 1
00:58:04	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr
00:58:04 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc694d: serviceaccount "payload-processing-e2e-ipp-a-fc694d" not found
00:58:04	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-fc694d	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659 from 0 to 1
00:58:05	openshift-ingress	multus	payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz	AddedInterface	Add eth0 [10.132.0.117/23] from ovn-kubernetes
00:58:05	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr	AddedInterface	Add eth0 [10.134.0.138/23] from ovn-kubernetes
00:58:05	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:58:05	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr	Created	Container created
00:58:05	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr	Started	Container started
00:58:05	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz	Started	Container started
00:58:05	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz	Created	Container created
00:58:05	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:58:07	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-dce655-5ddc9f875-tkqgd	Killing	Stopping container payload-pre-processing
00:58:07	openshift-ingress	kubelet	payload-processing-e2e-api-a-dce655-d997fcc5f-8jk76	Killing	Stopping container payload-processing
00:58:12	openshift-ingress	kubelet	payload-processing-e2e-mt-ef1f397c-696fb75475-nnfjw	Killing	Stopping container payload-processing
00:58:12	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-ef1f397c-56459cb94c-rnzcr	Killing	Stopping container payload-pre-processing
00:58:31	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-z5wrf	Killing	Stopping container istio-proxy
00:58:31	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Killing	Stopping container istio-proxy
00:58:31	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-d8xmc	Killing	Stopping container istio-proxy
00:58:31	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-4w9qb	Killing	Stopping container istio-proxy
00:58:33	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:58:33	openshift-ingress	kubelet	e2e-api-a-38d3a2-openshift-default-86c5544c5f-8b9xw	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:58:40	openshift-ingress	kubelet	payload-processing-e2e-api-b-9496d3-bc54d89b7-ph9v9	Killing	Stopping container payload-processing
00:58:41	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9496d3-9b4dcbf55-7mjjq	Killing	Stopping container payload-pre-processing
00:58:43	openshift-ingress	kubelet	e2e-api-a-dce655-openshift-default-676dcd9985-bcqnj	Killing	Stopping container istio-proxy
00:58:45 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	SuccessfulRescale	New size: 3; reason: All metrics below target
00:58:45 (x2)	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 4 to 3
00:58:45	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulDelete	Deleted pod: e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6
00:58:45	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-ndhl6	Killing	Stopping container istio-proxy
00:58:49	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-ee0d47-79f75964dc-8c9vx	Killing	Stopping container payload-pre-processing
00:58:49	openshift-ingress	kubelet	payload-processing-e2e-api-b-ee0d47-7568758575-8kqnt	Killing	Stopping container payload-processing
00:58:54 (x2)	openshift-ingress	kubelet	e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:58:54 (x2)	openshift-ingress	kubelet	e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	Created	Container created
00:58:54 (x2)	openshift-ingress	kubelet	e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	Started	Container started
00:59:00 (x6)	openshift-ingress	kubelet	e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	Unhealthy	Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
00:59:00 (x6)	openshift-ingress	kubelet	e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	ProbeError	Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
00:59:10	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-5b8666bdcf-qzp9j	Killing	Stopping container payload-processing
00:59:10	openshift-ingress	replicaset-controller	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc	SuccessfulCreate	Created pod: e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm
00:59:10	openshift-ingress	deployment-controller	e2e-ipp-b-907ff5-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-b-907ff5-openshift-default-5bb76c85bc from 0 to 1
00:59:10	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-864985986c-nwlsc	Killing	Stopping container payload-pre-processing
00:59:10	openshift-ingress	gateway_labeler_controller	e2e-ipp-b-907ff5	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-907ff5
00:59:11	openshift-ingress	multus	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	AddedInterface	Add eth0 [10.133.0.91/23] from ovn-kubernetes
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-hkm88	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	Killing	Stopping container istio-proxy
00:59:13	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	Killing	Stopping container istio-proxy
00:59:14	openshift-ingress	deployment-controller	e2e-api-a-1b6a42-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-1b6a42-openshift-default-c464c488f from 0 to 1
00:59:14	openshift-ingress	replicaset-controller	e2e-api-a-1b6a42-openshift-default-c464c488f	SuccessfulCreate	Created pod: e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5
00:59:14	openshift-ingress	gateway_labeler_controller	e2e-api-a-1b6a42	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1b6a42
00:59:15	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x	Killing	Stopping container istio-proxy
00:59:15	openshift-ingress	multus	e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	AddedInterface	Add eth0 [10.134.0.140/23] from ovn-kubernetes
00:59:15	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-b-907ff5 namespace
00:59:15	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-8rp2x
00:59:15	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 1; reason: All metrics below target
00:59:15 (x2)	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 3 to 2
00:59:15	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulDelete	Deleted pod: e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf
00:59:15 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	SuccessfulRescale	New size: 2; reason: All metrics below target
00:59:15	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-p6dgf	Killing	Stopping container istio-proxy
00:59:15	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 2 to 1
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ltr8j	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-gcf6k	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-lrv5f	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:16	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-r5k6w	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-d82gj	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:17 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-265a7f-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-ngrtw	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-7pm2x	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:17	openshift-ingress	kubelet	e2e-mt-ef1f397c-openshift-default-685bdc4857-p97lk	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:17 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-265a7f-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:59:18 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-907ff5: serviceaccount "payload-processing-e2e-ipp-b-907ff5" not found
00:59:18	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-907ff5	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-907ff5-565cd8bf85 from 0 to 1
00:59:18 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-907ff5-565cd8bf85	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-907ff5-565cd8bf85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-907ff5: serviceaccount "payload-processing-e2e-ipp-b-907ff5" not found
00:59:18	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-907ff5	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c from 0 to 1
00:59:19	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw
00:59:19	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-907ff5-565cd8bf85	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v
00:59:19	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw	AddedInterface	Add eth0 [10.132.0.118/23] from ovn-kubernetes
00:59:20	openshift-ingress	multus	payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v	AddedInterface	Add eth0 [10.134.0.141/23] from ovn-kubernetes
00:59:20	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw	Started	Container started
00:59:20	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw	Created	Container created
00:59:20	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:20	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:20	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-a-1b6a42 namespace
00:59:20	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v	Started	Container started
00:59:20	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v	Created	Container created
00:59:22 (x2)	openshift-ingress	kubelet	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	Started	Container started
00:59:22 (x2)	openshift-ingress	kubelet	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:59:22 (x2)	openshift-ingress	kubelet	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	Created	Container created
00:59:23 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-1b6a42-66f946f86c	FailedCreate	Error creating: pods "payload-processing-e2e-api-a-1b6a42-66f946f86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1b6a42: serviceaccount "payload-processing-e2e-api-a-1b6a42" not found
00:59:23 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1b6a42: serviceaccount "payload-processing-e2e-api-a-1b6a42" not found
00:59:23	openshift-ingress	deployment-controller	payload-processing-e2e-api-a-1b6a42	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-a-1b6a42-66f946f86c from 0 to 1
00:59:23	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb
00:59:23	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-a-1b6a42	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7 from 0 to 1
00:59:24	openshift-ingress	kubelet	payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:24	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-1b6a42-66f946f86c	SuccessfulCreate	Created pod: payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p
00:59:24	openshift-ingress	kubelet	payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p	Created	Container created
00:59:24	openshift-ingress	multus	payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p	AddedInterface	Add eth0 [10.132.0.120/23] from ovn-kubernetes
00:59:24	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb	Started	Container started
00:59:24	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb	Created	Container created
00:59:24	openshift-ingress	kubelet	payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p	Started	Container started
00:59:24	openshift-ingress	multus	payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb	AddedInterface	Add eth0 [10.132.0.119/23] from ovn-kubernetes
00:59:24	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:26 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc694d-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:59:26 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc694d-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:59:28 (x6)	openshift-ingress	kubelet	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	ProbeError	Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
00:59:28 (x6)	openshift-ingress	kubelet	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	Unhealthy	Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
00:59:29	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-1b6a42-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:59:29	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-1b6a42-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:59:33	openshift-ingress	kubelet	e2e-api-b-9496d3-openshift-default-55dccf9597-gnm46	Killing	Stopping container istio-proxy
00:59:34	openshift-ingress	replicaset-controller	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5	SuccessfulCreate	Created pod: e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw
00:59:34	openshift-ingress	gateway_labeler_controller	e2e-ipp-a-fc34e3	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-fc34e3
00:59:34	openshift-ingress	deployment-controller	e2e-ipp-a-fc34e3-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-a-fc34e3-openshift-default-564bb94fc5 from 0 to 1
00:59:35	openshift-ingress	multus	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	AddedInterface	Add eth0 [10.133.0.92/23] from ovn-kubernetes
00:59:39	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-a-fc34e3 namespace
00:59:41 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc694d-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:59:41 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc694d-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:59:42 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc34e3: serviceaccount "payload-processing-e2e-ipp-a-fc34e3" not found
00:59:42	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-fc34e3	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c from 0 to 1
00:59:42 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc34e3-75dd85444f	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-fc34e3-75dd85444f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc34e3: serviceaccount "payload-processing-e2e-ipp-a-fc34e3" not found
00:59:42	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-fc34e3	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-fc34e3-75dd85444f from 0 to 1
00:59:43	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47
00:59:43	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:43	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc34e3-75dd85444f	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz
00:59:43	openshift-ingress	multus	payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz	AddedInterface	Add eth0 [10.134.0.142/23] from ovn-kubernetes
00:59:43	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47	AddedInterface	Add eth0 [10.134.0.143/23] from ovn-kubernetes
00:59:44	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz	Created	Container created
00:59:44	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz	Started	Container started
00:59:44	openshift-ingress	kubelet	e2e-api-b-ee0d47-openshift-default-5b96858985-n284q	Killing	Stopping container istio-proxy
00:59:44	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47	Started	Container started
00:59:44	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47	Created	Container created
00:59:44	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:45	openshift-ingress	replicaset-controller	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877	SuccessfulCreate	Created pod: e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz
00:59:45	openshift-ingress	gateway_labeler_controller	e2e-ipp-a-4d1327	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-4d1327
00:59:45	openshift-ingress	deployment-controller	e2e-ipp-a-4d1327-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-a-4d1327-openshift-default-7dc8c4d877 from 0 to 1
00:59:46	openshift-ingress	multus	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	AddedInterface	Add eth0 [10.133.0.93/23] from ovn-kubernetes
00:59:48	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-6c64c5b659-rt5xr	Killing	Stopping container payload-pre-processing
00:59:48	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-c77db45d5-dxdpz	Killing	Stopping container payload-processing
00:59:49	openshift-ingress	replicaset-controller	e2e-ipp-b-28f2c4-openshift-default-6b9df899	SuccessfulCreate	Created pod: e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27
00:59:49	openshift-ingress	deployment-controller	e2e-ipp-b-28f2c4-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-b-28f2c4-openshift-default-6b9df899 from 0 to 1
00:59:49	openshift-ingress	gateway_labeler_controller	e2e-ipp-b-28f2c4	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-28f2c4
00:59:50	openshift-ingress	multus	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	AddedInterface	Add eth0 [10.134.0.144/23] from ovn-kubernetes
00:59:51	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-a-4d1327 namespace
00:59:51	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-265a7f	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-265a7f-688ddf8cfb from 0 to 1
00:59:52	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-265a7f	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf from 0 to 1
00:59:52 (x8)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-265a7f: serviceaccount "payload-processing-e2e-ipp-a-265a7f" not found
00:59:53	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx
00:59:53 (x9)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-265a7f: serviceaccount "payload-processing-e2e-ipp-a-265a7f" not found
00:59:54	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-4d1327-58b64cd759	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj
00:59:54	openshift-ingress	multus	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w	AddedInterface	Add eth0 [10.132.0.122/23] from ovn-kubernetes
00:59:54	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-4d1327	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-4d1327-58b64cd759 from 0 to 1
00:59:54 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-4d1327-58b64cd759	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-4d1327-58b64cd759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d1327: serviceaccount "payload-processing-e2e-ipp-a-4d1327" not found
00:59:54	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
00:59:54	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w
00:59:54	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx	AddedInterface	Add eth0 [10.132.0.121/23] from ovn-kubernetes
00:59:54 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d1327: serviceaccount "payload-processing-e2e-ipp-a-4d1327" not found
00:59:54	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-4d1327	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c from 0 to 1
00:59:55	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj	Created	Container created
00:59:55	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-b-28f2c4 namespace
00:59:55	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:55	openshift-ingress	multus	payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj	AddedInterface	Add eth0 [10.134.0.145/23] from ovn-kubernetes
00:59:55	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
00:59:55	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f
00:59:55	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f	AddedInterface	Add eth0 [10.134.0.146/23] from ovn-kubernetes
00:59:55	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
00:59:55	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj	Started	Container started
00:59:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx	Started	Container started
00:59:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.481s (2.481s including waiting). Image size: 166620835 bytes.
00:59:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx	Created	Container created
00:59:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f	Created	Container created
00:59:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f	Started	Container started
00:59:57	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w	Started	Container started
00:59:57	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w	Created	Container created
00:59:57	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.603s (2.603s including waiting). Image size: 166620835 bytes.
00:59:59 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-28f2c4-756c9747	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-28f2c4: serviceaccount "payload-processing-e2e-ipp-b-28f2c4" not found
00:59:59	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-28f2c4	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-28f2c4-854bbf84b5 from 0 to 1
00:59:59	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-28f2c4	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-28f2c4-756c9747 from 0 to 1
00:59:59	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-28f2c4-756c9747	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2
00:59:59 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-28f2c4-854bbf84b5	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-28f2c4: serviceaccount "payload-processing-e2e-ipp-b-28f2c4" not found
00:59:59	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-28f2c4-854bbf84b5	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f
01:00:00	openshift-ingress	multus	payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f	AddedInterface	Add eth0 [10.134.0.148/23] from ovn-kubernetes
01:00:00	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f	Created	Container created
01:00:00	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2	AddedInterface	Add eth0 [10.134.0.147/23] from ovn-kubernetes
01:00:00	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:00:00	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:00:00	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2	Created	Container created
01:00:00	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f	Started	Container started
01:00:00	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2	Started	Container started
01:00:24	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	Killing	Stopping container istio-proxy
01:00:24	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x
01:00:24	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 3; reason: All metrics below target
01:00:28	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:00:28	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-gxq9x	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:00:29	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Unhealthy	Readiness probe failed: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:00:29	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	ProbeError	Readiness probe error: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:00:30 (x2)	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Created	Container created
01:00:30 (x2)	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:00:30 (x2)	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Started	Container started
01:00:34	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-fc694d	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-fc694d-75f59cb8db from 0 to 1
01:00:34	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-fc694d	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867 from 0 to 1
01:00:35	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj
01:00:35 (x8)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc694d: serviceaccount "payload-processing-e2e-ipp-a-fc694d" not found
01:00:35 (x9)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc694d-75f59cb8db	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-fc694d-75f59cb8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc694d: serviceaccount "payload-processing-e2e-ipp-a-fc694d" not found
01:00:36	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
01:00:36 (x5)	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Unhealthy	Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
01:00:36	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2
01:00:36 (x5)	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	ProbeError	Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
01:00:36	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 4 to 3
01:00:36	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc694d-75f59cb8db	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb
01:00:36	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 3; reason: All metrics below target
01:00:36	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Killing	Stopping container istio-proxy
01:00:36	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj	AddedInterface	Add eth0 [10.134.0.151/23] from ovn-kubernetes
01:00:37	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
01:00:37	openshift-ingress	multus	payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb	AddedInterface	Add eth0 [10.133.0.100/23] from ovn-kubernetes
01:00:39	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj	Created	Container created
01:00:39	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj	Started	Container started
01:00:39	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb	Started	Container started
01:00:39	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb	Created	Container created
01:00:39	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.707s (1.707s including waiting). Image size: 166620835 bytes.
01:00:39	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:00:39	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-v8qs2	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:00:39	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.574s (2.574s including waiting). Image size: 166620835 bytes.
01:00:41 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-907ff5-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:00:41 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-907ff5-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:00:55 (x2)	openshift-ingress	kubelet	e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:00:56	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-907ff5-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:00:56 (x2)	openshift-ingress	kubelet	e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	Created	Container created
01:00:56	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-907ff5-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:00:56 (x2)	openshift-ingress	kubelet	e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	Started	Container started
01:01:02 (x6)	openshift-ingress	kubelet	e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	Unhealthy	Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused
01:01:02 (x6)	openshift-ingress	kubelet	e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	ProbeError	Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:
01:01:11 (x2)	openshift-ingress	kubelet	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	Started	Container started
01:01:11 (x2)	openshift-ingress	kubelet	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:01:11 (x2)	openshift-ingress	kubelet	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	Created	Container created
01:01:15 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-1b6a42-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:01:15 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-a-1b6a42-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:01:17	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w	Killing	Stopping container istio-proxy
01:01:17	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-hp58w
01:01:17	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 3; reason: All metrics below target
01:01:18 (x6)	openshift-ingress	kubelet	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	ProbeError	Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
01:01:18 (x6)	openshift-ingress	kubelet	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	Unhealthy	Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
01:01:20	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc34e3-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:01:20	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc34e3-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:01:23	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-565cd8bf85-tnr9v	Killing	Stopping container payload-processing
01:01:23	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-9ccf89b4c-blslw	Killing	Stopping container payload-pre-processing
01:01:26 (x2)	openshift-ingress	kubelet	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:01:27 (x2)	openshift-ingress	kubelet	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	Started	Container started
01:01:27 (x2)	openshift-ingress	kubelet	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	Created	Container created
01:01:27	openshift-ingress	gateway_labeler_controller	e2e-api-b-9212a1	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9212a1
01:01:28	openshift-ingress	deployment-controller	e2e-api-b-9212a1-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-9212a1-openshift-default-69d7977787 from 0 to 1
01:01:28	openshift-ingress	replicaset-controller	e2e-api-b-9212a1-openshift-default-69d7977787	SuccessfulCreate	Created pod: e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt
01:01:29 (x2)	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:01:29 (x2)	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	Started	Container started
01:01:29	openshift-ingress	multus	e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	AddedInterface	Add eth0 [10.134.0.154/23] from ovn-kubernetes
01:01:29 (x2)	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	Created	Container created
01:01:31	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-4d1327-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:01:31	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-4d1327-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:01:32 (x5)	openshift-ingress	kubelet	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	ProbeError	Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
01:01:32	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-b-9212a1 namespace
01:01:32 (x5)	openshift-ingress	kubelet	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	Unhealthy	Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
01:01:35 (x5)	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	Unhealthy	Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
01:01:35	openshift-ingress	deployment-controller	payload-processing-e2e-api-b-9212a1	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-b-9212a1-fbfbc7645 from 0 to 1
01:01:35 (x5)	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	ProbeError	Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
01:01:35	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-b-9212a1	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-b-9212a1-567c9fc775 from 0 to 1
01:01:36 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-9212a1-fbfbc7645	FailedCreate	Error creating: pods "payload-processing-e2e-api-b-9212a1-fbfbc7645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9212a1: serviceaccount "payload-processing-e2e-api-b-9212a1" not found
01:01:36	openshift-ingress	multus	payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp	AddedInterface	Add eth0 [10.134.0.155/23] from ovn-kubernetes
01:01:36	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:01:36	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-9212a1-fbfbc7645	SuccessfulCreate	Created pod: payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq
01:01:36 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-9212a1-567c9fc775	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-b-9212a1-567c9fc775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9212a1: serviceaccount "payload-processing-e2e-api-b-9212a1" not found
01:01:36	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-9212a1-567c9fc775	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp
01:01:37	openshift-ingress	kubelet	payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:01:37	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp	Started	Container started
01:01:37	openshift-ingress	kubelet	payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq	Created	Container created
01:01:37	openshift-ingress	kubelet	payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq	Started	Container started
01:01:37	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp	Created	Container created
01:01:37	openshift-ingress	multus	payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq	AddedInterface	Add eth0 [10.134.0.156/23] from ovn-kubernetes
01:01:50 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-28f2c4-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:01:50 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-28f2c4-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:01:50 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc34e3-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:01:50 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-fc34e3-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:01:53	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5cfbb4b98c-lwj47	Killing	Stopping container payload-pre-processing
01:01:53	openshift-ingress	gateway_labeler_controller	e2e-ipp-b-1bb4d7	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1bb4d7
01:01:53	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-75dd85444f-7vcjz	Killing	Stopping container payload-processing
01:01:54	openshift-ingress	replicaset-controller	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765	SuccessfulCreate	Created pod: e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg
01:01:54	openshift-ingress	deployment-controller	e2e-ipp-b-1bb4d7-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765 from 0 to 1
01:01:54	openshift-ingress	multus	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	AddedInterface	Add eth0 [10.134.0.157/23] from ovn-kubernetes
01:01:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-b-1bb4d7 namespace
01:02:02	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-1bb4d7	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf from 0 to 1
01:02:02 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-1bb4d7-7b77f99579	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1bb4d7: serviceaccount "payload-processing-e2e-ipp-b-1bb4d7" not found
01:02:02 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-4d1327-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:02:02 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-a-4d1327-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:02:02 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1bb4d7: serviceaccount "payload-processing-e2e-ipp-b-1bb4d7" not found
01:02:02	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-1bb4d7	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-1bb4d7-7b77f99579 from 0 to 1
01:02:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf	Started	Container started
01:02:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf	Created	Container created
01:02:03	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf	AddedInterface	Add eth0 [10.134.0.158/23] from ovn-kubernetes
01:02:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:02:03	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-1bb4d7-7b77f99579	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn
01:02:03	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf
01:02:04	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:02:04	openshift-ingress	multus	payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn	AddedInterface	Add eth0 [10.134.0.159/23] from ovn-kubernetes
01:02:04	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn	Created	Container created
01:02:04	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn	Started	Container started
01:02:05 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-28f2c4-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:02:05 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-28f2c4-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:02:13	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-58b64cd759-gcmrj	Killing	Stopping container payload-processing
01:02:13	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6c6bdc9c8c-9hk8f	Killing	Stopping container payload-pre-processing
01:02:18	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-848f6bf8bc from 10 to 7
01:02:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4fnf7	Killing	Stopping container istio-proxy
01:02:18	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-28f2c4-756c9747-86bq2	Killing	Stopping container payload-pre-processing
01:02:18	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 7; reason: All metrics below target
01:02:18	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-596nd
01:02:18	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-kpl6n
01:02:18	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-4fnf7
01:02:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-kpl6n	Killing	Stopping container istio-proxy
01:02:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-596nd	Killing	Stopping container istio-proxy
01:02:18	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-28f2c4-854bbf84b5-5ph8f	Killing	Stopping container payload-processing
01:02:28	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-907ff5	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d from 0 to 1
01:02:28	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-907ff5	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-907ff5-544d656c47 from 0 to 1
01:02:29 (x9)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-907ff5: serviceaccount "payload-processing-e2e-ipp-b-907ff5" not found
01:02:29 (x8)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-907ff5-544d656c47	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-907ff5: serviceaccount "payload-processing-e2e-ipp-b-907ff5" not found
01:02:30	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb	Created	Container created
01:02:30	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb	Started	Container started
01:02:30	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:02:30	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb	AddedInterface	Add eth0 [10.134.0.160/23] from ovn-kubernetes
01:02:30	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g
01:02:30	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-907ff5-544d656c47	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb
01:02:31	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g	Created	Container created
01:02:31	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g	Started	Container started
01:02:31	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:02:31	openshift-ingress	multus	payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g	AddedInterface	Add eth0 [10.134.0.161/23] from ovn-kubernetes
01:02:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc694d-7988dd9867-2vkzj	Killing	Stopping container payload-pre-processing
01:02:56	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc694d-75f59cb8db-cjkpb	Killing	Stopping container payload-processing
01:03:01	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-fc34e3	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-fc34e3-5859b5dff4 from 0 to 1
01:03:02	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-fc34e3	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c from 0 to 1
01:03:03 (x9)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc34e3-5859b5dff4	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc34e3: serviceaccount "payload-processing-e2e-ipp-a-fc34e3" not found
01:03:03	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp
01:03:03 (x8)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc34e3: serviceaccount "payload-processing-e2e-ipp-a-fc34e3" not found
01:03:03	openshift-ingress	kubelet	e2e-ipp-a-fc694d-openshift-default-56b9d5fcd7-b27k4	Killing	Stopping container istio-proxy
01:03:04	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp	Started	Container started
01:03:04	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-fc34e3-5859b5dff4	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx
01:03:04	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp	Created	Container created
01:03:04	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:03:04	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp	AddedInterface	Add eth0 [10.134.0.162/23] from ovn-kubernetes
01:03:05	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx	Started	Container started
01:03:05	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx	Created	Container created
01:03:05	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:03:05	openshift-ingress	multus	payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx	AddedInterface	Add eth0 [10.133.0.101/23] from ovn-kubernetes
01:03:16	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-265a7f-688ddf8cfb-6z98w	Killing	Stopping container payload-processing
01:03:16	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-265a7f-56c84f69cf-hpbqx	Killing	Stopping container payload-pre-processing
01:03:20	openshift-ingress	kubelet	e2e-ipp-a-265a7f-openshift-default-6648c84f49-vh2c5	Killing	Stopping container istio-proxy
01:03:21	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-4d1327	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-4d1327-65758c676d from 0 to 1
01:03:22 (x8)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d1327: serviceaccount "payload-processing-e2e-ipp-a-4d1327" not found
01:03:22	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-4d1327	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55 from 0 to 1
01:03:23	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm
01:03:23 (x9)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-4d1327-65758c676d	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-4d1327-65758c676d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d1327: serviceaccount "payload-processing-e2e-ipp-a-4d1327" not found
01:03:24	openshift-ingress	multus	payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c	AddedInterface	Add eth0 [10.134.0.163/23] from ovn-kubernetes
01:03:24	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm	Created	Container created
01:03:24	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-4d1327-65758c676d	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c
01:03:24	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm	Started	Container started
01:03:24	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm	AddedInterface	Add eth0 [10.133.0.102/23] from ovn-kubernetes
01:03:24	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:03:25	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:03:25	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c	Created	Container created
01:03:25	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c	Started	Container started
01:03:33	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	Killing	Stopping container istio-proxy
01:03:35	openshift-ingress	deployment-controller	e2e-praxis-a-2aa557-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-a-2aa557-openshift-default-9c6895445 from 0 to 1
01:03:35	openshift-ingress	gateway_labeler_controller	e2e-praxis-a-2aa557	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-2aa557
01:03:36	openshift-ingress	multus	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	AddedInterface	Add eth0 [10.133.0.103/23] from ovn-kubernetes
01:03:36	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:03:36	openshift-ingress	replicaset-controller	e2e-praxis-a-2aa557-openshift-default-9c6895445	SuccessfulCreate	Created pod: e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm
01:03:36	openshift-ingress	kubelet	e2e-ipp-b-28f2c4-openshift-default-6b9df899-qhd27	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:03:37	openshift-ingress	gateway_labeler_controller	e2e-ipp-b-58660e	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-58660e
01:03:37	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-907ff5-69fcbf8c7d-f9q4g	Killing	Stopping container payload-processing
01:03:37	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-907ff5-544d656c47-wc8rb	Killing	Stopping container payload-pre-processing
01:03:38	openshift-ingress	deployment-controller	e2e-ipp-b-58660e-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-b-58660e-openshift-default-547ffdb4df from 0 to 1
01:03:38	openshift-ingress	replicaset-controller	e2e-ipp-b-58660e-openshift-default-547ffdb4df	SuccessfulCreate	Created pod: e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5
01:03:38	openshift-ingress	multus	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	AddedInterface	Add eth0 [10.134.0.164/23] from ovn-kubernetes
01:03:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-a-2aa557 namespace
01:03:43	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-b-58660e namespace
01:03:44 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2aa557: serviceaccount "payload-processing-e2e-praxis-a-2aa557" not found
01:03:44 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-2aa557-545ddd664f	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-a-2aa557-545ddd664f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2aa557: serviceaccount "payload-processing-e2e-praxis-a-2aa557" not found
01:03:44	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-a-2aa557	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-a-2aa557-545ddd664f from 0 to 1
01:03:44	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-a-2aa557	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67 from 0 to 1
01:03:45	openshift-ingress	multus	payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr	AddedInterface	Add eth0 [10.132.0.128/23] from ovn-kubernetes
01:03:45	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr
01:03:45	openshift-ingress	multus	payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc	AddedInterface	Add eth0 [10.132.0.129/23] from ovn-kubernetes
01:03:45	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:03:45	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr	Created	Container created
01:03:45	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr	Started	Container started
01:03:45	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-2aa557-545ddd664f	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc
01:03:46	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc	Created	Container created
01:03:46 (x2)	openshift-ingress	kubelet	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	Created	Container created
01:03:46 (x2)	openshift-ingress	kubelet	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:03:46	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc	Started	Container started
01:03:46	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:03:46 (x2)	openshift-ingress	kubelet	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	Started	Container started
01:03:47	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Killing	Stopping container istio-proxy
01:03:49 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-58660e: serviceaccount "payload-processing-e2e-ipp-b-58660e" not found
01:03:49	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-58660e	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-58660e-75f5556f55 from 0 to 1
01:03:49 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-58660e-75f5556f55	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-58660e-75f5556f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-58660e: serviceaccount "payload-processing-e2e-ipp-b-58660e" not found
01:03:49	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-58660e	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc from 0 to 1
01:03:50	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:03:50	openshift-ingress	deployment-controller	e2e-praxis-a-589bdf-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9 from 0 to 1
01:03:50	openshift-ingress	replicaset-controller	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9	SuccessfulCreate	Created pod: e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw
01:03:50	openshift-ingress	multus	payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5	AddedInterface	Add eth0 [10.132.0.131/23] from ovn-kubernetes
01:03:50	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7	AddedInterface	Add eth0 [10.132.0.130/23] from ovn-kubernetes
01:03:50	openshift-ingress	gateway_labeler_controller	e2e-praxis-a-589bdf	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-589bdf
01:03:50	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-58660e-75f5556f55	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5
01:03:50	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7
01:03:51	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:03:51	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7	Started	Container started
01:03:51	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7	Created	Container created
01:03:51	openshift-ingress	multus	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	AddedInterface	Add eth0 [10.134.0.165/23] from ovn-kubernetes
01:03:51	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5	Created	Container created
01:03:51	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5	Started	Container started
01:03:52	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:03:52 (x5)	openshift-ingress	kubelet	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	ProbeError	Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
01:03:52 (x5)	openshift-ingress	kubelet	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	Unhealthy	Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused
01:03:52	openshift-ingress	kubelet	e2e-ipp-b-907ff5-openshift-default-5bb76c85bc-vppvm	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:03:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-a-589bdf namespace
01:03:57	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-a-589bdf	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-a-589bdf-96c9ddb75 from 0 to 1
01:03:58	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-a-589bdf	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-a-589bdf-cd7675555 from 0 to 1
01:03:58 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-589bdf-cd7675555	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-589bdf: serviceaccount "payload-processing-e2e-praxis-a-589bdf" not found
01:03:58 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-589bdf-96c9ddb75	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-a-589bdf-96c9ddb75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-589bdf: serviceaccount "payload-processing-e2e-praxis-a-589bdf" not found
01:03:58	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-589bdf-96c9ddb75	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm
01:03:58	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-589bdf-cd7675555	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k
01:03:59	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k	Created	Container created
01:03:59	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k	Started	Container started
01:03:59	openshift-ingress	multus	payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k	AddedInterface	Add eth0 [10.132.0.132/23] from ovn-kubernetes
01:03:59	openshift-ingress	multus	payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm	AddedInterface	Add eth0 [10.132.0.133/23] from ovn-kubernetes
01:03:59	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm	Started	Container started
01:03:59	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm	Created	Container created
01:03:59	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:03:59	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:04:10 (x2)	openshift-ingress	kubelet	e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:04:10 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-1bb4d7-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:04:10 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-1bb4d7-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:04:10 (x2)	openshift-ingress	kubelet	e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	Started	Container started
01:04:10 (x2)	openshift-ingress	kubelet	e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	Created	Container created
01:04:14 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9212a1-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:04:14 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9212a1-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:04:16	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-1b6a42-8f76d8db7-gclsb	Killing	Stopping container payload-pre-processing
01:04:16 (x5)	openshift-ingress	kubelet	e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	Unhealthy	Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused
01:04:16 (x5)	openshift-ingress	kubelet	e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	ProbeError	Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
01:04:16	openshift-ingress	kubelet	payload-processing-e2e-api-a-1b6a42-66f946f86c-znt9p	Killing	Stopping container payload-processing
01:04:28	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-7b77f99579-922vn	Killing	Stopping container payload-processing
01:04:29	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-6cf558ccf-dcqzf	Killing	Stopping container payload-pre-processing
01:04:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9212a1-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:04:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-api-b-9212a1-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:04:52	openshift-ingress	kubelet	e2e-api-a-1b6a42-openshift-default-c464c488f-29qz5	Killing	Stopping container istio-proxy
01:04:58	openshift-ingress	kubelet	payload-processing-e2e-api-b-9212a1-fbfbc7645-bclqq	Killing	Stopping container payload-processing
01:04:58	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-9212a1-567c9fc775-wzbhp	Killing	Stopping container payload-pre-processing
01:05:12	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7ddd9cfdc8	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-g8m28
01:05:12	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	ProbeError	Readiness probe error: Get "http://10.134.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:05:12	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:05:12	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-g8m28	Killing	Stopping container discovery
01:05:12	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	Killing	Stopping container istio-proxy
01:05:12	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:05:12	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Unhealthy	Readiness probe failed: Get "http://10.134.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:05:12	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-6xjkj
01:05:13 (x2)	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Started	Container started
01:05:13 (x2)	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	Created	Container created
01:05:13 (x2)	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	Started	Container started
01:05:13 (x2)	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:05:13 (x2)	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Created	Container created
01:05:13 (x2)	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:05:17	openshift-ingress	kubelet	e2e-api-b-9212a1-openshift-default-69d7977787-l4ttt	Killing	Stopping container istio-proxy
01:05:18	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulDelete	Deleted pod: e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4
01:05:18 (x5)	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Unhealthy	Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused
01:05:18	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-fc34e3-5859b5dff4-pwfqx	Killing	Stopping container payload-processing
01:05:18 (x5)	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	ProbeError	Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused body:
01:05:18	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-fc34e3-5c5558774c-t5sbp	Killing	Stopping container payload-pre-processing
01:05:18	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	Killing	Stopping container istio-proxy
01:05:19	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Killing	Stopping container istio-proxy
01:05:19 (x6)	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	Unhealthy	Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
01:05:19	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Killing	Stopping container istio-proxy
01:05:19	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-848f6bf8bc from 7 to 4
01:05:19	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-7krwg
01:05:19	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n
01:05:19	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-4wnxp
01:05:19	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-gdtdr
01:05:19	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	Killing	Stopping container istio-proxy
01:05:19 (x6)	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	ProbeError	Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
01:05:19	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-4wnxp	Killing	Stopping container istio-proxy
01:05:20	openshift-ingress	replicaset-controller	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf	SuccessfulCreate	Created pod: e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr
01:05:20	openshift-ingress	deployment-controller	e2e-praxis-a-8c6878-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf from 0 to 1
01:05:20	openshift-ingress	gateway_labeler_controller	e2e-praxis-a-8c6878	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-8c6878
01:05:21	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-2aa557-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:05:21	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-2aa557-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:05:21	openshift-ingress	multus	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	AddedInterface	Add eth0 [10.133.0.104/23] from ovn-kubernetes
01:05:22	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:05:22	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:05:22	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7krwg	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:05:22	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-zl7c4	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:05:23	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:05:23	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gdtdr	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:05:23	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:05:23	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-jlt8n	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:05:24	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq
01:05:24	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 2; reason: All metrics below target
01:05:24 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-58660e-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:05:24	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	Killing	Stopping container istio-proxy
01:05:24 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-58660e-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:05:24	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:05:24	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-ff8rq	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:05:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-a-8c6878 namespace
01:05:28	openshift-ingress	kubelet	e2e-ipp-a-fc34e3-openshift-default-564bb94fc5-7dxzw	Killing	Stopping container istio-proxy
01:05:30	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-1bb4d7	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d from 0 to 1
01:05:31	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-1bb4d7	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9 from 0 to 1
01:05:31 (x8)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1bb4d7: serviceaccount "payload-processing-e2e-ipp-b-1bb4d7" not found
01:05:31 (x9)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1bb4d7: serviceaccount "payload-processing-e2e-ipp-b-1bb4d7" not found
01:05:32	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-a-8c6878	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-a-8c6878-6f7c745cbc from 0 to 1
01:05:32	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49
01:05:32	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-a-8c6878	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947 from 0 to 1
01:05:33	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx
01:05:33	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:05:33	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49	Created	Container created
01:05:33	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49	Started	Container started
01:05:33	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49	AddedInterface	Add eth0 [10.134.0.167/23] from ovn-kubernetes
01:05:33 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-8c6878-6f7c745cbc	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8c6878: serviceaccount "payload-processing-e2e-praxis-a-8c6878" not found
01:05:33	openshift-ingress	multus	payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx	AddedInterface	Add eth0 [10.134.0.168/23] from ovn-kubernetes
01:05:33	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-8c6878-6f7c745cbc	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz
01:05:33	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:05:33	openshift-ingress	multus	payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2	AddedInterface	Add eth0 [10.134.0.169/23] from ovn-kubernetes
01:05:33 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8c6878: serviceaccount "payload-processing-e2e-praxis-a-8c6878" not found
01:05:33	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2
01:05:34	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:05:34	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz	Started	Container started
01:05:34	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2	Started	Container started
01:05:34	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx	Started	Container started
01:05:34	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz	Created	Container created
01:05:34	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:05:34	openshift-ingress	multus	payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz	AddedInterface	Add eth0 [10.134.0.170/23] from ovn-kubernetes
01:05:34	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx	Created	Container created
01:05:34	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2	Created	Container created
01:05:36	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-8c6878-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:05:36	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-8c6878-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:05:39	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-58660e-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:05:39	openshift-ingress	horizontal-pod-autoscaler	e2e-ipp-b-58660e-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:05:43 (x2)	openshift-ingress	kubelet	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:05:43 (x2)	openshift-ingress	kubelet	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	Started	Container started
01:05:43 (x2)	openshift-ingress	kubelet	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	Created	Container created
01:05:49 (x5)	openshift-ingress	kubelet	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	ProbeError	Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
01:05:49 (x5)	openshift-ingress	kubelet	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	Unhealthy	Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
01:05:51 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-589bdf-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:05:51 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-589bdf-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:05:52 (x6)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-2aa557-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:05:52 (x6)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-2aa557-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:06:00	openshift-ingress	gateway_labeler_controller	e2e-praxis-b-2f02f5	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-2f02f5
01:06:01	openshift-ingress	deployment-controller	e2e-praxis-b-2f02f5-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-b-2f02f5-openshift-default-5bfcb5669 from 0 to 1
01:06:01	openshift-ingress	replicaset-controller	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669	SuccessfulCreate	Created pod: e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk
01:06:01	openshift-ingress	multus	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	AddedInterface	Add eth0 [10.134.0.171/23] from ovn-kubernetes
01:06:06	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-75f5556f55-t9ff5	Killing	Stopping container payload-processing
01:06:06	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-59c5f8dc-cghg7	Killing	Stopping container payload-pre-processing
01:06:06	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-b-2f02f5 namespace
01:06:09	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-b-2f02f5	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f from 0 to 1
01:06:09	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-b-2f02f5	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-b-2f02f5-64884dc6f5 from 0 to 1
01:06:10 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-2f02f5-64884dc6f5	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2f02f5: serviceaccount "payload-processing-e2e-praxis-b-2f02f5" not found
01:06:10	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9
01:06:10 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2f02f5: serviceaccount "payload-processing-e2e-praxis-b-2f02f5" not found
01:06:10	openshift-ingress	multus	payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9	AddedInterface	Add eth0 [10.132.0.136/23] from ovn-kubernetes
01:06:10	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-2f02f5-64884dc6f5	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf
01:06:11	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:06:11	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:06:11	openshift-ingress	multus	payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf	AddedInterface	Add eth0 [10.132.0.137/23] from ovn-kubernetes
01:06:11	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf	Created	Container created
01:06:11	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf	Started	Container started
01:06:11	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9	Created	Container created
01:06:11	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9	Started	Container started
01:06:19	openshift-ingress	gateway_labeler_controller	e2e-praxis-b-18cc66	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-18cc66
01:06:20	openshift-ingress	replicaset-controller	e2e-praxis-b-18cc66-openshift-default-858478f9bf	SuccessfulCreate	Created pod: e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w
01:06:20	openshift-ingress	deployment-controller	e2e-praxis-b-18cc66-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-b-18cc66-openshift-default-858478f9bf from 0 to 1
01:06:21 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-589bdf-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:06:21	openshift-ingress	multus	e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	AddedInterface	Add eth0 [10.134.0.172/23] from ovn-kubernetes
01:06:21 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-589bdf-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:06:24	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-b-18cc66 namespace
01:06:28	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-b-18cc66	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-b-18cc66-855b49f467 from 0 to 1
01:06:28 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-18cc66-68cf6d646c	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-b-18cc66-68cf6d646c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-18cc66: serviceaccount "payload-processing-e2e-praxis-b-18cc66" not found
01:06:28 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-18cc66-855b49f467	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-18cc66: serviceaccount "payload-processing-e2e-praxis-b-18cc66" not found
01:06:28	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-18cc66-855b49f467	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r
01:06:28	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-18cc66-68cf6d646c	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt
01:06:28	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-b-18cc66	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-b-18cc66-68cf6d646c from 0 to 1
01:06:29	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r	Started	Container started
01:06:29	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt	Created	Container created
01:06:29	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:06:29	openshift-ingress	multus	payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt	AddedInterface	Add eth0 [10.132.0.140/23] from ovn-kubernetes
01:06:29	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:06:29	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r	Created	Container created
01:06:29	openshift-ingress	multus	payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r	AddedInterface	Add eth0 [10.132.0.139/23] from ovn-kubernetes
01:06:29	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt	Started	Container started
01:06:33	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-1bb4d7-6bbff8454d-gf4hx	Killing	Stopping container payload-processing
01:06:33	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-1bb4d7-597b8f75f9-wkn49	Killing	Stopping container payload-pre-processing
01:06:40	openshift-ingress	kubelet	e2e-ipp-b-1bb4d7-openshift-default-5f95bd5765-rtnpg	Killing	Stopping container istio-proxy
01:06:42	openshift-ingress	deployment-controller	e2e-praxis-a-bf564e-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-a-bf564e-openshift-default-75f468569c from 0 to 1
01:06:42	openshift-ingress	replicaset-controller	e2e-praxis-a-bf564e-openshift-default-75f468569c	SuccessfulCreate	Created pod: e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8
01:06:42	openshift-ingress	gateway_labeler_controller	e2e-praxis-a-bf564e	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-bf564e
01:06:43	openshift-ingress	multus	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	AddedInterface	Add eth0 [10.133.0.105/23] from ovn-kubernetes
01:06:46	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-a-bf564e namespace
01:06:49	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-a-bf564e	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-a-bf564e-5c675d6567 from 0 to 1
01:06:50	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-bf564e-5c675d6567	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx
01:06:50 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-bf564e: serviceaccount "payload-processing-e2e-praxis-a-bf564e" not found
01:06:50	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd
01:06:50 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-bf564e-5c675d6567	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-a-bf564e-5c675d6567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-bf564e: serviceaccount "payload-processing-e2e-praxis-a-bf564e" not found
01:06:50	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-a-bf564e	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc from 0 to 1
01:06:51	openshift-ingress	multus	payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx	AddedInterface	Add eth0 [10.134.0.173/23] from ovn-kubernetes
01:06:51	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx	Started	Container started
01:06:51	openshift-ingress	multus	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd	AddedInterface	Add eth0 [10.132.0.141/23] from ovn-kubernetes
01:06:51	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd	Started	Container started
01:06:51	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd	Created	Container created
01:06:51	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:06:51	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx	Created	Container created
01:06:51	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:06:52 (x2)	openshift-ingress	kubelet	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:06:53 (x2)	openshift-ingress	kubelet	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	Created	Container created
01:06:53 (x2)	openshift-ingress	kubelet	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	Started	Container started
01:06:58 (x5)	openshift-ingress	kubelet	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	ProbeError	Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
01:06:58 (x5)	openshift-ingress	kubelet	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	Unhealthy	Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
01:07:01	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-58660e	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5 from 0 to 1
01:07:01	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-58660e	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-58660e-7d9bf896b8 from 0 to 1
01:07:02 (x8)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-58660e: serviceaccount "payload-processing-e2e-ipp-b-58660e" not found
01:07:02 (x9)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-58660e-7d9bf896b8	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-58660e-7d9bf896b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-58660e: serviceaccount "payload-processing-e2e-ipp-b-58660e" not found
01:07:03	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk
01:07:03	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-58660e-7d9bf896b8	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7
01:07:04	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:07:04	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk	AddedInterface	Add eth0 [10.134.0.174/23] from ovn-kubernetes
01:07:04	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7	Started	Container started
01:07:04	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
01:07:04	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7	Created	Container created
01:07:04	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk	Started	Container started
01:07:04	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk	Created	Container created
01:07:04	openshift-ingress	multus	payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7	AddedInterface	Add eth0 [10.134.0.175/23] from ovn-kubernetes
01:07:36 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-8c6878-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:07:36 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-8c6878-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:07:38 (x2)	openshift-ingress	kubelet	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	Started	Container started
01:07:38 (x2)	openshift-ingress	kubelet	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:07:38 (x2)	openshift-ingress	kubelet	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	Created	Container created
01:07:44 (x5)	openshift-ingress	kubelet	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	Unhealthy	Startup probe failed: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused
01:07:44 (x5)	openshift-ingress	kubelet	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	ProbeError	Startup probe error: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused body:
01:07:47	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-2f02f5-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:07:47	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-2f02f5-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:07:50	openshift-ingress	deployment-controller	e2e-praxis-b-8eaee2-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-b-8eaee2-openshift-default-5b65f989 from 0 to 1
01:07:50	openshift-ingress	gateway_labeler_controller	e2e-praxis-b-8eaee2	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-8eaee2
01:07:50	openshift-ingress	replicaset-controller	e2e-praxis-b-8eaee2-openshift-default-5b65f989	SuccessfulCreate	Created pod: e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b
01:07:51	openshift-ingress	multus	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	AddedInterface	Add eth0 [10.134.0.176/23] from ovn-kubernetes
01:07:56	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-b-8eaee2 namespace
01:07:59	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-8eaee2-85b477dbc7	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft
01:07:59	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-b-8eaee2	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-b-8eaee2-85b477dbc7 from 0 to 1
01:07:59 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-8eaee2-85b477dbc7	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-8eaee2: serviceaccount "payload-processing-e2e-praxis-b-8eaee2" not found
01:07:59 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-8eaee2: serviceaccount "payload-processing-e2e-praxis-b-8eaee2" not found
01:07:59	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh
01:07:59	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-b-8eaee2	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc from 0 to 1
01:08:00	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:08:00	openshift-ingress	multus	payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft	AddedInterface	Add eth0 [10.134.0.177/23] from ovn-kubernetes
01:08:00	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh	Pulling	Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
01:08:00	openshift-ingress	multus	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh	AddedInterface	Add eth0 [10.133.0.106/23] from ovn-kubernetes
01:08:00	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft	Created	Container created
01:08:00	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft	Started	Container started
01:08:03	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh	Pulled	Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.664s (2.664s including waiting). Image size: 125353965 bytes.
01:08:03	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh	Started	Container started
01:08:03	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh	Created	Container created
01:08:05 (x2)	openshift-ingress	kubelet	e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	Started	Container started
01:08:05 (x2)	openshift-ingress	kubelet	e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	Created	Container created
01:08:05 (x2)	openshift-ingress	kubelet	e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:08:06	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-18cc66-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:08:06	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-18cc66-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:08:11 (x6)	openshift-ingress	kubelet	e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	ProbeError	Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:
01:08:11 (x6)	openshift-ingress	kubelet	e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	Unhealthy	Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused
01:08:22 (x2)	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	Created	Container created
01:08:22 (x2)	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	Started	Container started
01:08:22 (x2)	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:08:27 (x5)	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	Unhealthy	Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
01:08:27 (x5)	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	ProbeError	Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:
01:08:28 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-bf564e-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:08:28 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-bf564e-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:08:32 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-2f02f5-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:08:32 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-2f02f5-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:08:40	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-2aa557-545ddd664f-lqgbc	Killing	Stopping container payload-processing
01:08:40	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-2aa557-5c7d5ddb67-rscmr	Killing	Stopping container payload-pre-processing
01:08:43	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-bf564e-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:08:43	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-bf564e-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:08:51 (x6)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-18cc66-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:08:51 (x6)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-18cc66-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:09:06	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-589bdf-cd7675555-bfs7k	Killing	Stopping container payload-pre-processing
01:09:06	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-589bdf-96c9ddb75-2l9sm	Killing	Stopping container payload-processing
01:09:14 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	(combined from similar events): New size: 1; reason: All metrics below target
01:09:14	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-48xgr
01:09:14	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-48xgr	Killing	Stopping container istio-proxy
01:09:21	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-gjtnr
01:09:21	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-gjtnr	Killing	Stopping container istio-proxy
01:09:26	openshift-ingress	gateway_labeler_controller	e2e-praxis-b-ab3381	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ab3381
01:09:27	openshift-ingress	multus	e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	AddedInterface	Add eth0 [10.133.0.107/23] from ovn-kubernetes
01:09:27	openshift-ingress	deployment-controller	e2e-praxis-b-ab3381-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-b-ab3381-openshift-default-7d85bf9885 from 0 to 1
01:09:27	openshift-ingress	replicaset-controller	e2e-praxis-b-ab3381-openshift-default-7d85bf9885	SuccessfulCreate	Created pod: e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629
01:09:31	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	Killing	Stopping container istio-proxy
01:09:32	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-b-ab3381 namespace
01:09:35	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-b-ab3381	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-b-ab3381-69c8d5755c from 0 to 1
01:09:35	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:09:35	openshift-ingress	kubelet	e2e-praxis-a-2aa557-openshift-default-9c6895445-pkxdm	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:09:36 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ab3381: serviceaccount "payload-processing-e2e-praxis-b-ab3381" not found
01:09:36	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp
01:09:36	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-b-ab3381	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf from 0 to 1
01:09:36	openshift-ingress	multus	payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp	AddedInterface	Add eth0 [10.133.0.108/23] from ovn-kubernetes
01:09:36 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-ab3381-69c8d5755c	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-b-ab3381-69c8d5755c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ab3381: serviceaccount "payload-processing-e2e-praxis-b-ab3381" not found
01:09:36	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-ab3381-69c8d5755c	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786
01:09:37	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:09:37	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp	Started	Container started
01:09:37	openshift-ingress	multus	payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786	AddedInterface	Add eth0 [10.133.0.109/23] from ovn-kubernetes
01:09:37	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:09:37	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786	Started	Container started
01:09:37	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp	Created	Container created
01:09:37	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786	Created	Container created
01:09:39	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-2f02f5-64884dc6f5-jbqzf	Killing	Stopping container payload-processing
01:09:39	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-2f02f5-6b89657b7f-lmnw9	Killing	Stopping container payload-pre-processing
01:09:39	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	ProbeError	Readiness probe error: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:09:39	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	Unhealthy	Readiness probe failed: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:09:42 (x2)	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	Started	Container started
01:09:42 (x2)	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:09:42 (x2)	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	Created	Container created
01:09:48 (x5)	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	ProbeError	Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:
01:09:48 (x5)	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	Unhealthy	Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused
01:09:59	openshift-ingress	kubelet	e2e-praxis-a-589bdf-openshift-default-5f9d66bcb9-g47lw	Killing	Stopping container istio-proxy
01:10:06 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-8eaee2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:10:06 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-8eaee2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:10:07	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-18cc66-68cf6d646c-ch7dt	Killing	Stopping container payload-processing
01:10:07	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-18cc66-855b49f467-pj78r	Killing	Stopping container payload-pre-processing
01:10:21	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-h59pc
01:10:21	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-h59pc	Killing	Stopping container istio-proxy
01:10:22 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-8eaee2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:10:22 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-8eaee2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:10:26	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	(combined from similar events): New size: 1; reason: All metrics below target
01:10:26	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulDelete	Deleted pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8
01:10:26 (x2)	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	(combined from similar events): Scaled down replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 2 to 1
01:10:26	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-kjgb8	Killing	Stopping container istio-proxy
01:10:37	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-8c6878-6f7c745cbc-dmqkz	Killing	Stopping container payload-processing
01:10:37	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-8c6878-6577bfb947-8wvp2	Killing	Stopping container payload-pre-processing
01:11:04	openshift-ingress	kubelet	e2e-praxis-b-2f02f5-openshift-default-5bfcb5669-q89hk	Killing	Stopping container istio-proxy
01:11:14	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-4d1327-65758c676d-f4c2c	Killing	Stopping container payload-processing
01:11:14	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-4d1327-6944fcdb55-mrjdm	Killing	Stopping container payload-pre-processing
01:11:18	openshift-ingress	kubelet	e2e-praxis-b-18cc66-openshift-default-858478f9bf-bgt7w	Killing	Stopping container istio-proxy
01:11:20 (x2)	openshift-ingress	kubelet	e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	Started	Container started
01:11:20 (x2)	openshift-ingress	kubelet	e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	Created	Container created
01:11:20 (x2)	openshift-ingress	kubelet	e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:11:21	openshift-ingress	kubelet	e2e-praxis-a-8c6878-openshift-default-6bb8bc9cdf-9jsqr	Killing	Stopping container istio-proxy
01:11:22	openshift-ingress	kubelet	e2e-ipp-a-4d1327-openshift-default-7dc8c4d877-hv8gz	Killing	Stopping container istio-proxy
01:11:26 (x5)	openshift-ingress	kubelet	e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	ProbeError	Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
01:11:26 (x5)	openshift-ingress	kubelet	e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	Unhealthy	Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
01:11:28 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-ab3381-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:11:28 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-ab3381-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:11:29	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-8eaee2-767bfc49dc-clznh	Killing	Stopping container payload-pre-processing
01:11:29	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-8eaee2-85b477dbc7-rd6ft	Killing	Stopping container payload-processing
01:11:37	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n
01:11:37	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-fz27n	Killing	Stopping container istio-proxy
01:11:37	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-58660e-7cfcd8c7f5-rq8mk	Killing	Stopping container payload-pre-processing
01:11:37	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-58660e-7d9bf896b8-s55b7	Killing	Stopping container payload-processing
01:11:43	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-ab3381-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:11:43	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-ab3381-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:11:48	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Killing	Stopping container istio-proxy
01:11:49	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:11:49	openshift-ingress	kubelet	e2e-ipp-b-58660e-openshift-default-547ffdb4df-rvrv5	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:11:50	openshift-ingress	multus	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	AddedInterface	Add eth0 [10.134.0.182/23] from ovn-kubernetes
01:11:50	openshift-ingress	replicaset-controller	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489	SuccessfulCreate	Created pod: e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m
01:11:50	openshift-ingress	deployment-controller	e2e-praxis-a-28c1e9-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-a-28c1e9-openshift-default-7bd8c67489 from 0 to 1
01:11:50	openshift-ingress	gateway_labeler_controller	e2e-praxis-a-28c1e9	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-28c1e9
01:11:57	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-a-28c1e9	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-a-28c1e9-54895474c5 from 0 to 1
01:11:57	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-a-28c1e9	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f from 0 to 1
01:11:58	openshift-ingress	multus	payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm	AddedInterface	Add eth0 [10.134.0.186/23] from ovn-kubernetes
01:11:58	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-28c1e9-54895474c5	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm
01:11:58 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-a-28c1e9-54895474c5	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-a-28c1e9-54895474c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-28c1e9: serviceaccount "payload-processing-e2e-praxis-a-28c1e9" not found
01:11:58	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h
01:11:58 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-28c1e9: serviceaccount "payload-processing-e2e-praxis-a-28c1e9" not found
01:11:59	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm	Created	Container created
01:11:59	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h	Started	Container started
01:11:59	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:11:59	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm	Started	Container started
01:11:59	openshift-ingress	multus	payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h	AddedInterface	Add eth0 [10.134.0.185/23] from ovn-kubernetes
01:11:59	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:11:59	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h	Created	Container created
01:12:06	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq
01:12:07	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:12:07	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	AddedInterface	Add eth0 [10.133.0.112/23] from ovn-kubernetes
01:12:07	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	Started	Container started
01:12:07	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	Created	Container created
01:12:14 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	ProbeError	Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:
01:12:14 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	Unhealthy	Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused
01:12:22	openshift-ingress	kubelet	e2e-praxis-b-8eaee2-openshift-default-5b65f989-g575b	Killing	Stopping container istio-proxy
01:12:22	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc
01:12:23	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	Created	Container created
01:12:23	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	AddedInterface	Add eth0 [10.134.0.190/23] from ovn-kubernetes
01:12:23	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:12:23	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	Started	Container started
01:12:30 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	Unhealthy	Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
01:12:30 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	ProbeError	Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
01:12:52	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:12:52	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:12:52 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
01:12:52	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn
01:12:52	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5
01:12:52	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	Started	Container started
01:12:52	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	AddedInterface	Add eth0 [10.132.0.149/23] from ovn-kubernetes
01:12:52 (x2)	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 2 to 4
01:12:52	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	Created	Container created
01:12:52	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	AddedInterface	Add eth0 [10.134.0.193/23] from ovn-kubernetes
01:12:53	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	Started	Container started
01:12:53	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	Created	Container created
01:12:59 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	Unhealthy	Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused
01:12:59 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	ProbeError	Startup probe error: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused body:
01:12:59 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	ProbeError	Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:
01:12:59 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	Unhealthy	Startup probe failed: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused
01:13:02 (x2)	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:13:02 (x2)	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	Created	Container created
01:13:02 (x2)	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	Started	Container started
01:13:07	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5
01:13:07	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	AddedInterface	Add eth0 [10.133.0.114/23] from ovn-kubernetes
01:13:07	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 5; reason: All metrics below target
01:13:07	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 4 to 5
01:13:08 (x5)	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	ProbeError	Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
01:13:08	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr
01:13:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	Created	Container created
01:13:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	Started	Container started
01:13:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:13:08	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:13:08	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	AddedInterface	Add eth0 [10.133.0.115/23] from ovn-kubernetes
01:13:08 (x5)	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	Unhealthy	Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused
01:13:09	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	Started	Container started
01:13:09	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	Created	Container created
01:13:14 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	ProbeError	Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
01:13:14 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	Unhealthy	Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused
01:13:15 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	ProbeError	Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
01:13:15 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	Unhealthy	Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
01:13:21 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-28c1e9-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:13:21 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-28c1e9-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:13:30	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq
01:13:30 (x4)	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	(combined from similar events): Scaled up replica set e2e-worker-w1-552952-openshift-default-855478bdc from 1 to 2
01:13:31	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	AddedInterface	Add eth0 [10.133.0.117/23] from ovn-kubernetes
01:13:31	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	Started	Container started
01:13:31	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	Created	Container created
01:13:31	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:13:32	openshift-ingress	gateway_labeler_controller	e2e-praxis-b-f934de	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f934de
01:13:33	openshift-ingress	deployment-controller	e2e-praxis-b-f934de-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-praxis-b-f934de-openshift-default-dbb69fb5c from 0 to 1
01:13:33	openshift-ingress	multus	e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	AddedInterface	Add eth0 [10.134.0.198/23] from ovn-kubernetes
01:13:33	openshift-ingress	replicaset-controller	e2e-praxis-b-f934de-openshift-default-dbb69fb5c	SuccessfulCreate	Created pod: e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87
01:13:36	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w1-22e246	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-22e246
01:13:36 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-28c1e9-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:13:36	openshift-ingress	deployment-controller	e2e-shared-a-w1-22e246-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w1-22e246-openshift-default-58d9ff9759 from 0 to 1
01:13:36	openshift-ingress	replicaset-controller	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759	SuccessfulCreate	Created pod: e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn
01:13:36	openshift-ingress	multus	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	AddedInterface	Add eth0 [10.134.0.200/23] from ovn-kubernetes
01:13:36 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-a-28c1e9-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:13:37	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-b-f934de namespace
01:13:38 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	Unhealthy	Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
01:13:38 (x6)	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	ProbeError	Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
01:13:40 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-f934de-6f97d4b4d7	FailedCreate	Error creating: pods "payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f934de: serviceaccount "payload-processing-e2e-praxis-b-f934de" not found
01:13:40	openshift-ingress	replicaset-controller	payload-processing-e2e-praxis-b-f934de-6f97d4b4d7	SuccessfulCreate	Created pod: payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp
01:13:40 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff	FailedCreate	Error creating: pods "payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f934de: serviceaccount "payload-processing-e2e-praxis-b-f934de" not found
01:13:40	openshift-ingress	deployment-controller	payload-pre-processing-e2e-praxis-b-f934de	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff from 0 to 1
01:13:40	openshift-ingress	deployment-controller	payload-processing-e2e-praxis-b-f934de	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-praxis-b-f934de-6f97d4b4d7 from 0 to 1
01:13:41	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:13:41	openshift-ingress	multus	payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h	AddedInterface	Add eth0 [10.134.0.202/23] from ovn-kubernetes
01:13:41	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h	Created	Container created
01:13:41	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp	Started	Container started
01:13:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-a-w1-22e246 namespace
01:13:41	openshift-ingress	multus	payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp	AddedInterface	Add eth0 [10.134.0.201/23] from ovn-kubernetes
01:13:41	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h	Started	Container started
01:13:41	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff	SuccessfulCreate	Created pod: payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h
01:13:41	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:13:41	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp	Created	Container created
01:13:45	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg
01:13:45 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-22e246: serviceaccount "payload-processing-e2e-shared-a-w1-22e246" not found
01:13:45	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w1-22e246	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w1-22e246-545bdbdbf from 0 to 1
01:13:45	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w1-22e246	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f from 0 to 1
01:13:45	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd
01:13:45 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-22e246: serviceaccount "payload-processing-e2e-shared-a-w1-22e246" not found
01:13:46	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd	Started	Container started
01:13:46	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:13:46	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd	AddedInterface	Add eth0 [10.134.0.203/23] from ovn-kubernetes
01:13:46	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg	Started	Container started
01:13:46	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg	Created	Container created
01:13:46	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:13:46	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd	Created	Container created
01:13:46	openshift-ingress	multus	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg	AddedInterface	Add eth0 [10.134.0.204/23] from ovn-kubernetes
01:13:53	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v
01:13:53	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq
01:13:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	Started	Container started
01:13:54	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	AddedInterface	Add eth0 [10.133.0.119/23] from ovn-kubernetes
01:13:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:13:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	Created	Container created
01:13:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:13:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	Created	Container created
01:13:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	Started	Container started
01:13:54	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	AddedInterface	Add eth0 [10.134.0.205/23] from ovn-kubernetes
01:14:00 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	Unhealthy	Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused
01:14:00 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	ProbeError	Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
01:14:00 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	Unhealthy	Startup probe failed: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused
01:14:00 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	ProbeError	Startup probe error: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused body:
01:14:07	openshift-ingress	replicaset-controller	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff	SuccessfulCreate	Created pod: e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p
01:14:07	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72
01:14:07	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5
01:14:07	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w3-362c56	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-362c56
01:14:07	openshift-ingress	deployment-controller	e2e-shared-a-w3-362c56-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff from 0 to 1
01:14:07	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 5 to 7
01:14:07	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 7; reason: cpu resource utilization (percentage of request) above target
01:14:07	openshift-ingress	multus	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	AddedInterface	Add eth0 [10.134.0.207/23] from ovn-kubernetes
01:14:08	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	AddedInterface	Add eth0 [10.132.0.150/23] from ovn-kubernetes
01:14:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	Created	Container created
01:14:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	Started	Container started
01:14:08	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	AddedInterface	Add eth0 [10.134.0.208/23] from ovn-kubernetes
01:14:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	Started	Container started
01:14:08	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	Created	Container created
01:14:10	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulCreate	Created pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4
01:14:10	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w4-27fc07	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-27fc07
01:14:10	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 0 to 1
01:14:11	openshift-ingress	multus	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	AddedInterface	Add eth0 [10.134.0.209/23] from ovn-kubernetes
01:14:11	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-a-w3-362c56 namespace
01:14:14 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-362c56: serviceaccount "payload-processing-e2e-shared-a-w3-362c56" not found
01:14:14	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w3-362c56	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c from 0 to 1
01:14:14 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-362c56: serviceaccount "payload-processing-e2e-shared-a-w3-362c56" not found
01:14:14	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w3-362c56	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79 from 0 to 1
01:14:15 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	Unhealthy	Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused
01:14:15 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	Unhealthy	Startup probe failed: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused
01:14:15 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	ProbeError	Startup probe error: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused body:
01:14:15	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh	Created	Container created
01:14:15	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh
01:14:15	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:14:15	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh	Started	Container started
01:14:15	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-a-w4-27fc07 namespace
01:14:15 (x7)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	ProbeError	Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:
01:14:15	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh	AddedInterface	Add eth0 [10.132.0.151/23] from ovn-kubernetes
01:14:15	openshift-ingress	multus	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j	AddedInterface	Add eth0 [10.132.0.152/23] from ovn-kubernetes
01:14:15	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j
01:14:16	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j	Created	Container created
01:14:16	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j	Started	Container started
01:14:16	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:14:21	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w4-27fc07	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w4-27fc07-759d888567 from 0 to 1
01:14:22	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 7 to 10
01:14:22 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w4-27fc07-759d888567	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w4-27fc07-759d888567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-27fc07: serviceaccount "payload-processing-e2e-shared-a-w4-27fc07" not found
01:14:22	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 10; reason: cpu resource utilization (percentage of request) above target
01:14:22	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4
01:14:22	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w4-27fc07-759d888567	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt
01:14:22 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-27fc07: serviceaccount "payload-processing-e2e-shared-a-w4-27fc07" not found
01:14:22	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2
01:14:22	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w4-27fc07	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699 from 0 to 1
01:14:22	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44
01:14:22	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw
01:14:23	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5
01:14:23	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	Started	Container started
01:14:23	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:23	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:14:23	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c
01:14:23	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	Created	Container created
01:14:23	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2	Created	Container created
01:14:23	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:23	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2	Started	Container started
01:14:23 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 8; reason: cpu resource utilization (percentage of request) above target
01:14:23	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	AddedInterface	Add eth0 [10.134.0.210/23] from ovn-kubernetes
01:14:23	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:23	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt	Started	Container started
01:14:23	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt	Created	Container created
01:14:23	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:14:23	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	AddedInterface	Add eth0 [10.133.0.121/23] from ovn-kubernetes
01:14:23	openshift-ingress	multus	payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt	AddedInterface	Add eth0 [10.132.0.154/23] from ovn-kubernetes
01:14:23	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	AddedInterface	Add eth0 [10.132.0.155/23] from ovn-kubernetes
01:14:23	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps
01:14:23	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	Started	Container started
01:14:23	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2	AddedInterface	Add eth0 [10.132.0.153/23] from ovn-kubernetes
01:14:23	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	Created	Container created
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	Created	Container created
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	Started	Container started
01:14:24	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	Started	Container started
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	Started	Container started
01:14:24	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	Created	Container created
01:14:24	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	AddedInterface	Add eth0 [10.133.0.122/23] from ovn-kubernetes
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	Created	Container created
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	Started	Container started
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	Created	Container created
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:24	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	AddedInterface	Add eth0 [10.134.0.211/23] from ovn-kubernetes
01:14:24	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:24	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	AddedInterface	Add eth0 [10.132.0.157/23] from ovn-kubernetes
01:14:30 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	Unhealthy	Startup probe failed: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused
01:14:30 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	ProbeError	Startup probe error: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused body:
01:14:30 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	ProbeError	Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
01:14:30 (x6)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	Unhealthy	Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
01:14:31 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	Unhealthy	Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused
01:14:31 (x8)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	Unhealthy	Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
01:14:31 (x8)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	ProbeError	Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
01:14:31 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	Unhealthy	Startup probe failed: Get "http://10.134.0.211:15021/healthz/ready": dial tcp 10.134.0.211:15021: connect: connection refused
01:14:31 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	ProbeError	Startup probe error: Get "http://10.134.0.211:15021/healthz/ready": dial tcp 10.134.0.211:15021: connect: connection refused body:
01:14:31 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	ProbeError	Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
01:14:32 (x8)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	ProbeError	Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:
01:14:32 (x8)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	Unhealthy	Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused
01:14:33	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	Unhealthy	Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:14:33	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	ProbeError	Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:14:52	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx	Killing	Stopping container payload-processing
01:14:52	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd	Killing	Stopping container payload-pre-processing
01:14:54	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	AddedInterface	Add eth0 [10.132.0.159/23] from ovn-kubernetes
01:14:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:54	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh
01:14:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	Created	Container created
01:14:54	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	Started	Container started
01:14:54	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx
01:14:54 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 10; reason: cpu resource utilization (percentage of request) above target
01:14:55	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:14:55	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	AddedInterface	Add eth0 [10.134.0.213/23] from ovn-kubernetes
01:14:55	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	Created	Container created
01:14:55	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	Started	Container started
01:15:00 (x2)	openshift-ingress	kubelet	e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	Started	Container started
01:15:00 (x2)	openshift-ingress	kubelet	e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	Created	Container created
01:15:00 (x2)	openshift-ingress	kubelet	e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:15:01 (x2)	openshift-ingress	kubelet	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	Created	Container created
01:15:01 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	ProbeError	Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
01:15:01 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	Unhealthy	Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
01:15:01 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	ProbeError	Startup probe error: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused body:
01:15:01 (x2)	openshift-ingress	kubelet	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	Started	Container started
01:15:01 (x6)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	Unhealthy	Startup probe failed: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused
01:15:01 (x2)	openshift-ingress	kubelet	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:15:06 (x6)	openshift-ingress	kubelet	e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	Unhealthy	Startup probe failed: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused
01:15:06 (x6)	openshift-ingress	kubelet	e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	ProbeError	Startup probe error: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused body:
01:15:07	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w1-22e246-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:15:07	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w1-22e246-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:15:07 (x6)	openshift-ingress	kubelet	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	Unhealthy	Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused
01:15:07 (x6)	openshift-ingress	kubelet	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	ProbeError	Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:
01:15:09	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-9cx9g	Killing	Stopping container istio-proxy
01:15:09	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-9cx9g
01:15:13 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-bf564e-7c655bb7bc-k2xcd	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:15:13 (x2)	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-bf564e-5c675d6567-jxxvx	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:15:19 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-f934de-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:19 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-f934de-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:34 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-f934de-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:15:34 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-praxis-b-f934de-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:15:37 (x6)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w1-22e246-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:37 (x6)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w1-22e246-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:41	openshift-ingress	multus	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	AddedInterface	Add eth0 [10.134.0.219/23] from ovn-kubernetes
01:15:41	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:15:41	openshift-ingress	multus	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	AddedInterface	Add eth0 [10.132.0.162/23] from ovn-kubernetes
01:15:41	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:15:41	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulCreate	Created pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2
01:15:41	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulCreate	Created pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz
01:15:41	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 1 to 4
01:15:41	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
01:15:41	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	Unhealthy	Readiness probe failed: Get "http://10.134.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:15:41	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulCreate	Created pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m
01:15:41	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	ProbeError	Readiness probe error: Get "http://10.134.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:15:42	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:15:42	openshift-ingress	kubelet	payload-processing-e2e-praxis-a-28c1e9-54895474c5-n9rqm	Killing	Stopping container payload-processing
01:15:42 (x2)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:15:42	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	Started	Container started
01:15:42	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-a-28c1e9-6f9775467f-62x6h	Killing	Stopping container payload-pre-processing
01:15:42	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	Created	Container created
01:15:42	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	Created	Container created
01:15:42	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	Started	Container started
01:15:42	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	Started	Container started
01:15:42	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	Created	Container created
01:15:42 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:15:42	openshift-ingress	multus	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	AddedInterface	Add eth0 [10.133.0.130/23] from ovn-kubernetes
01:15:43 (x2)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	Started	Container started
01:15:43 (x2)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	Created	Container created
01:15:43 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	Created	Container created
01:15:43 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	Started	Container started
01:15:47 (x5)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	Unhealthy	Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
01:15:47 (x5)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	ProbeError	Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:
01:15:47 (x5)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	ProbeError	Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
01:15:47 (x5)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	Unhealthy	Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
01:15:48 (x6)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	ProbeError	Startup probe error: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused body:
01:15:48 (x6)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	Unhealthy	Startup probe failed: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused
01:15:49 (x6)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	ProbeError	Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:
01:15:49	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w1-cd9116	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-cd9116
01:15:49 (x6)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	Unhealthy	Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused
01:15:49 (x6)	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	Unhealthy	Startup probe failed: Get "http://10.134.0.207:15021/healthz/ready": dial tcp 10.134.0.207:15021: connect: connection refused
01:15:49 (x6)	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	ProbeError	Startup probe error: Get "http://10.134.0.207:15021/healthz/ready": dial tcp 10.134.0.207:15021: connect: connection refused body:
01:15:50	openshift-ingress	deployment-controller	e2e-shared-b-w1-cd9116-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7 from 0 to 1
01:15:50	openshift-ingress	replicaset-controller	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7	SuccessfulCreate	Created pod: e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk
01:15:51	openshift-ingress	multus	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	AddedInterface	Add eth0 [10.134.0.220/23] from ovn-kubernetes
01:15:53 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w3-362c56-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:53 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w3-362c56-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-b-w1-cd9116 namespace
01:15:56 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:56 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:15:57	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w1-cd9116	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965 from 0 to 1
01:15:57 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-cd9116: serviceaccount "payload-processing-e2e-shared-b-w1-cd9116" not found
01:15:57	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs
01:15:57	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w1-cd9116	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5 from 0 to 1
01:15:57 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-cd9116: serviceaccount "payload-processing-e2e-shared-b-w1-cd9116" not found
01:15:58	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z
01:15:58	openshift-ingress	multus	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z	AddedInterface	Add eth0 [10.133.0.131/23] from ovn-kubernetes
01:15:58	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:15:58	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs	Created	Container created
01:15:58	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs	AddedInterface	Add eth0 [10.134.0.221/23] from ovn-kubernetes
01:15:58	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z	Started	Container started
01:15:58	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs	Started	Container started
01:15:58	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z	Created	Container created
01:15:58	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:16:06 (x2)	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-praxis-a-28c1e9 namespace
01:16:08	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w3-362c56-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:16:08	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	Killing	Stopping container istio-proxy
01:16:08	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w3-362c56-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:16:09	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:16:09	openshift-ingress	kubelet	e2e-praxis-a-28c1e9-openshift-default-7bd8c67489-phf5m	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:16:11	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:16:11	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:16:14	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w3-8e2d45	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-8e2d45
01:16:14	openshift-ingress	replicaset-controller	e2e-shared-b-w3-8e2d45-openshift-default-555c556899	SuccessfulCreate	Created pod: e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk
01:16:14	openshift-ingress	deployment-controller	e2e-shared-b-w3-8e2d45-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w3-8e2d45-openshift-default-555c556899 from 0 to 1
01:16:15	openshift-ingress	multus	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	AddedInterface	Add eth0 [10.134.0.222/23] from ovn-kubernetes
01:16:19	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-b-w3-8e2d45 namespace
01:16:22	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w3-8e2d45	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w3-8e2d45-fb4548545 from 0 to 1
01:16:22	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w3-8e2d45	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679 from 0 to 1
01:16:23 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8e2d45: serviceaccount "payload-processing-e2e-shared-b-w3-8e2d45" not found
01:16:23	openshift-ingress	deployment-controller	e2e-shared-b-w4-faec96-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w4-faec96-openshift-default-5869cf6989 from 0 to 1
01:16:23	openshift-ingress	replicaset-controller	e2e-shared-b-w4-faec96-openshift-default-5869cf6989	SuccessfulCreate	Created pod: e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65
01:16:23	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w4-faec96	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-faec96
01:16:23 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8e2d45: serviceaccount "payload-processing-e2e-shared-b-w3-8e2d45" not found
01:16:23	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6
01:16:23	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx
01:16:24	openshift-ingress	multus	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx	AddedInterface	Add eth0 [10.134.0.224/23] from ovn-kubernetes
01:16:24	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6	Started	Container started
01:16:24	openshift-ingress	multus	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	AddedInterface	Add eth0 [10.133.0.132/23] from ovn-kubernetes
01:16:24	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6	AddedInterface	Add eth0 [10.134.0.223/23] from ovn-kubernetes
01:16:24	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:16:24	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:16:24	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx	Created	Container created
01:16:24	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx	Started	Container started
01:16:24	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6	Created	Container created
01:16:26	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 4 to 6
01:16:26	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulCreate	Created pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps
01:16:26	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-f934de-6fb4df66ff-wlp2h	Killing	Stopping container payload-pre-processing
01:16:26	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-f934de-6f97d4b4d7-pglpp	Killing	Stopping container payload-processing
01:16:26	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	SuccessfulRescale	New size: 6; reason: All metrics below target
01:16:26	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulCreate	Created pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl
01:16:27	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:16:27	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	Started	Container started
01:16:27	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	Started	Container started
01:16:27	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:16:27	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	Created	Container created
01:16:27	openshift-ingress	multus	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	AddedInterface	Add eth0 [10.133.0.133/23] from ovn-kubernetes
01:16:27	openshift-ingress	multus	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	AddedInterface	Add eth0 [10.132.0.163/23] from ovn-kubernetes
01:16:27	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	Created	Container created
01:16:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-b-w4-faec96 namespace
01:16:31	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w4-faec96	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575 from 0 to 1
01:16:31	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w4-faec96	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w4-faec96-56df9cd747 from 0 to 1
01:16:32	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w4-faec96-56df9cd747	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv
01:16:32 (x5)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	ProbeError	Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
01:16:32 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-faec96: serviceaccount "payload-processing-e2e-shared-b-w4-faec96" not found
01:16:32 (x5)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	Unhealthy	Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused
01:16:32	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7
01:16:32 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w4-faec96-56df9cd747	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w4-faec96-56df9cd747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-faec96: serviceaccount "payload-processing-e2e-shared-b-w4-faec96" not found
01:16:33	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7	Started	Container started
01:16:33	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv	Started	Container started
01:16:33	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7	Created	Container created
01:16:33	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv	Created	Container created
01:16:33	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:16:33	openshift-ingress	multus	payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv	AddedInterface	Add eth0 [10.134.0.226/23] from ovn-kubernetes
01:16:33 (x6)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	ProbeError	Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:
01:16:33	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:16:33	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7	AddedInterface	Add eth0 [10.134.0.225/23] from ovn-kubernetes
01:16:33 (x6)	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	Unhealthy	Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused
01:16:42	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	Killing	Stopping container istio-proxy
01:16:43	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:16:43	openshift-ingress	kubelet	e2e-praxis-a-bf564e-openshift-default-75f468569c-29sh8	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:16:47 (x2)	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2
01:16:47 (x2)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:16:47	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7ddd9cfdc8	SuccessfulCreate	Created pod: istiod-openshift-gateway-7ddd9cfdc8-jnjb8
01:16:48	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-jnjb8	Created	Container created
01:16:48	openshift-ingress	multus	istiod-openshift-gateway-7ddd9cfdc8-jnjb8	AddedInterface	Add eth0 [10.132.0.164/23] from ovn-kubernetes
01:16:48	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-jnjb8	Started	Container started
01:16:48	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-jnjb8	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
01:16:49	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-jnjb8	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:16:49	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-jnjb8	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:16:50	openshift-ingress	kubelet	payload-processing-e2e-praxis-b-ab3381-69c8d5755c-5k786	Killing	Stopping container payload-processing
01:16:50	openshift-ingress	kubelet	payload-pre-processing-e2e-praxis-b-ab3381-7768bd9fcf-7k2bp	Killing	Stopping container payload-pre-processing
01:17:27 (x2)	openshift-ingress	kubelet	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:17:27 (x2)	openshift-ingress	kubelet	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	Created	Container created
01:17:27 (x2)	openshift-ingress	kubelet	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	Started	Container started
01:17:33 (x6)	openshift-ingress	kubelet	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	ProbeError	Startup probe error: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused body:
01:17:33 (x6)	openshift-ingress	kubelet	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	Unhealthy	Startup probe failed: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused
01:17:43 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:17:43 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	Started	Container started
01:17:43 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	Created	Container created
01:17:46	openshift-ingress	kubelet	e2e-praxis-b-f934de-openshift-default-dbb69fb5c-76f87	Killing	Stopping container istio-proxy
01:17:49 (x5)	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	Unhealthy	Startup probe failed: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused
01:17:49 (x5)	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	ProbeError	Startup probe error: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused body:
01:17:51 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w1-cd9116-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:17:51 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w1-cd9116-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:17:58	openshift-ingress	kubelet	e2e-praxis-b-ab3381-openshift-default-7d85bf9885-qc629	Killing	Stopping container istio-proxy
01:18:00 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w3-8e2d45-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:18:00 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w3-8e2d45-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:18:06 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w1-cd9116-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:18:06 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w1-cd9116-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:18:08 (x2)	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:18:08 (x2)	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	Started	Container started
01:18:08 (x2)	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	Created	Container created
01:18:11	openshift-ingress	deployment-controller	e2e-shared-a-w2-4ed7e0-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5 from 0 to 1
01:18:11	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w2-4ed7e0	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-4ed7e0
01:18:12	openshift-ingress	multus	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	AddedInterface	Add eth0 [10.134.0.229/23] from ovn-kubernetes
01:18:12	openshift-ingress	replicaset-controller	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5	SuccessfulCreate	Created pod: e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst
01:18:13 (x5)	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	Unhealthy	Startup probe failed: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused
01:18:13 (x5)	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	ProbeError	Startup probe error: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused body:
01:18:15 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w3-8e2d45-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:18:15 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w3-8e2d45-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:18:17	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-a-w2-4ed7e0 namespace
01:18:20	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p
01:18:20	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w2-4ed7e0	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f from 0 to 1
01:18:20 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4ed7e0: serviceaccount "payload-processing-e2e-shared-a-w2-4ed7e0" not found
01:18:20	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w2-4ed7e0	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7 from 0 to 1
01:18:20	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt
01:18:20 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4ed7e0: serviceaccount "payload-processing-e2e-shared-a-w2-4ed7e0" not found
01:18:21	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt	AddedInterface	Add eth0 [10.134.0.231/23] from ovn-kubernetes
01:18:21	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt	Started	Container started
01:18:21	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p	Created	Container created
01:18:21	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt	Created	Container created
01:18:21	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p	Started	Container started
01:18:21	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:18:21	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:18:21	openshift-ingress	multus	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p	AddedInterface	Add eth0 [10.134.0.230/23] from ovn-kubernetes
01:18:28	openshift-ingress	gateway_labeler_controller	e2e-autores-334c6a	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-autores-334c6a
01:18:28	openshift-ingress	deployment-controller	e2e-autores-334c6a-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-autores-334c6a-openshift-default-8659f944c9 from 0 to 1
01:18:28	openshift-ingress	replicaset-controller	e2e-autores-334c6a-openshift-default-8659f944c9	SuccessfulCreate	Created pod: e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp
01:18:29	openshift-ingress	multus	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	AddedInterface	Add eth0 [10.133.0.137/23] from ovn-kubernetes
01:18:33	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-autores-334c6a namespace
01:18:36	openshift-ingress	deployment-controller	payload-processing-e2e-autores-334c6a	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-autores-334c6a-65568666f7 from 0 to 1
01:18:36	openshift-ingress	deployment-controller	payload-pre-processing-e2e-autores-334c6a	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-autores-334c6a-579c7f89c5 from 0 to 1
01:18:37	openshift-ingress	multus	payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl	AddedInterface	Add eth0 [10.133.0.138/23] from ovn-kubernetes
01:18:37 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-autores-334c6a-65568666f7	FailedCreate	Error creating: pods "payload-processing-e2e-autores-334c6a-65568666f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-334c6a: serviceaccount "payload-processing-e2e-autores-334c6a" not found
01:18:37	openshift-ingress	replicaset-controller	payload-processing-e2e-autores-334c6a-65568666f7	SuccessfulCreate	Created pod: payload-processing-e2e-autores-334c6a-65568666f7-84f5v
01:18:37	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-autores-334c6a-579c7f89c5	SuccessfulCreate	Created pod: payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl
01:18:37	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:18:37 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-autores-334c6a-579c7f89c5	FailedCreate	Error creating: pods "payload-pre-processing-e2e-autores-334c6a-579c7f89c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-334c6a: serviceaccount "payload-processing-e2e-autores-334c6a" not found
01:18:38	openshift-ingress	multus	payload-processing-e2e-autores-334c6a-65568666f7-84f5v	AddedInterface	Add eth0 [10.133.0.139/23] from ovn-kubernetes
01:18:38	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl	Started	Container started
01:18:38	openshift-ingress	kubelet	payload-processing-e2e-autores-334c6a-65568666f7-84f5v	Created	Container created
01:18:38	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl	Created	Container created
01:18:38	openshift-ingress	kubelet	payload-processing-e2e-autores-334c6a-65568666f7-84f5v	Started	Container started
01:18:38	openshift-ingress	kubelet	payload-processing-e2e-autores-334c6a-65568666f7-84f5v	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:18:39 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:18:39 (x2)	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 1 to 2
01:18:39	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulCreate	Created pod: e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5
01:18:39 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w4-faec96-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:18:39 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w4-faec96-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:18:40	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	Created	Container created
01:18:40	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	Started	Container started
01:18:40	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:18:40	openshift-ingress	multus	e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	AddedInterface	Add eth0 [10.134.0.232/23] from ovn-kubernetes
01:18:47 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	Unhealthy	Startup probe failed: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused
01:18:47 (x6)	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	ProbeError	Startup probe error: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused body:
01:19:01	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq	Killing	Stopping container istio-proxy
01:19:01	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulDelete	(combined from similar events): Deleted pod: e2e-worker-w1-552952-openshift-default-855478bdc-sxxnq
01:19:01	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 1; reason: All metrics below target
01:19:01	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w1-552952-openshift-default-855478bdc from 2 to 1
01:19:25	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 6; reason: All metrics below target
01:19:25	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5
01:19:25	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7
01:19:25	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4	Killing	Stopping container istio-proxy
01:19:25	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-mldl4
01:19:25	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72	Killing	Stopping container istio-proxy
01:19:25	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 10 to 6
01:19:25	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-66f72
01:19:25	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-ql4h7	Killing	Stopping container istio-proxy
01:19:25	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	Killing	Stopping container istio-proxy
01:19:31	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	ProbeError	Readiness probe error: Get "http://10.134.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:19:31	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-9xfl5	Unhealthy	Readiness probe failed: Get "http://10.134.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:19:49 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:19:50 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	Created	Container created
01:19:50 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	Started	Container started
01:19:55	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	Killing	Stopping container istio-proxy
01:19:55	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5
01:19:55	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44	Killing	Stopping container istio-proxy
01:19:55	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 4; reason: All metrics below target
01:19:55 (x5)	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	Unhealthy	Startup probe failed: Get "http://10.134.0.229:15021/healthz/ready": dial tcp 10.134.0.229:15021: connect: connection refused
01:19:55 (x5)	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	ProbeError	Startup probe error: Get "http://10.134.0.229:15021/healthz/ready": dial tcp 10.134.0.229:15021: connect: connection refused body:
01:19:55	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 6 to 4
01:19:55	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-4sl44
01:19:56	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-6svsq	Killing	Stopping container istio-proxy
01:19:56	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-97p5c	Killing	Stopping container istio-proxy
01:19:56	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-nxq8v	Killing	Stopping container istio-proxy
01:19:56	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-5wmxh	Killing	Stopping container istio-proxy
01:19:57 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w2-4ed7e0-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:19:57 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w2-4ed7e0-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:19:57	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	Killing	Stopping container istio-proxy
01:20:00	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	ProbeError	Readiness probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
01:20:00	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-pnxk5	Unhealthy	Readiness probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused
01:20:02	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	ProbeError	Readiness probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
01:20:02	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-tklxc	Unhealthy	Readiness probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
01:20:08 (x2)	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	Created	Container created
01:20:08 (x2)	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:20:08 (x2)	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	Started	Container started
01:20:13 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w2-4ed7e0-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:20:13 (x5)	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	Unhealthy	Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
01:20:13 (x5)	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	ProbeError	Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
01:20:13 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w2-4ed7e0-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:20:14	openshift-ingress	horizontal-pod-autoscaler	e2e-autores-334c6a-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:20:14	openshift-ingress	horizontal-pod-autoscaler	e2e-autores-334c6a-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:20:41	openshift-ingress	replicaset-controller	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9	SuccessfulCreate	Created pod: e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj
01:20:41	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w2-5fedc7	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5fedc7
01:20:41	openshift-ingress	deployment-controller	e2e-shared-b-w2-5fedc7-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9 from 0 to 1
01:20:42	openshift-ingress	multus	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	AddedInterface	Add eth0 [10.134.0.237/23] from ovn-kubernetes
01:20:43	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps	Killing	Stopping container istio-proxy
01:20:43	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulDelete	Deleted pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-zhcps
01:20:43	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 6 to 5
01:20:43	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	SuccessfulRescale	New size: 5; reason: All metrics below target
01:20:44 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-autores-334c6a-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:20:44 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-autores-334c6a-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:20:46	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-b-w2-5fedc7 namespace
01:20:49 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5fedc7: serviceaccount "payload-processing-e2e-shared-b-w2-5fedc7" not found
01:20:49	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w2-5fedc7	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7 from 0 to 1
01:20:49 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5fedc7: serviceaccount "payload-processing-e2e-shared-b-w2-5fedc7" not found
01:20:49	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w2-5fedc7	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc from 0 to 1
01:20:50	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:20:50	openshift-ingress	multus	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26	AddedInterface	Add eth0 [10.133.0.141/23] from ovn-kubernetes
01:20:50	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c	Created	Container created
01:20:50	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c	Started	Container started
01:20:50	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c
01:20:50	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26
01:20:50	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c	AddedInterface	Add eth0 [10.134.0.238/23] from ovn-kubernetes
01:20:51	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26	Created	Container created
01:20:51	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26	Started	Container started
01:20:51	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:21:42 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 4; reason: All metrics below target
01:21:42 (x7)	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	(combined from similar events): Scaled down replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 5 to 4
01:21:42	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-w56x5	Killing	Stopping container istio-proxy
01:21:44	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulDelete	Deleted pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz
01:21:44	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-b56rz	Killing	Stopping container istio-proxy
01:21:44	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 5 to 4
01:21:44	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	SuccessfulRescale	New size: 4; reason: All metrics below target
01:21:56	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5
01:21:56 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 3; reason: All metrics below target
01:21:56	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	Killing	Stopping container istio-proxy
01:21:56 (x2)	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 4 to 3
01:21:57 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	(combined from similar events): New size: 3; reason: All metrics below target
01:21:57	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	Killing	Stopping container istio-proxy
01:21:57 (x2)	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 4 to 3
01:22:01	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:22:01	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-qx2m5	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:22:02	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	Unhealthy	Readiness probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
01:22:02	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-sdbqx	ProbeError	Readiness probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
01:22:04 (x2)	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1
01:22:04 (x2)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	SuccessfulRescale	New size: 1; reason: All metrics below target
01:22:04	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-jnjb8	Killing	Stopping container discovery
01:22:04	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7ddd9cfdc8	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-jnjb8
01:22:30	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	ProbeError	Readiness probe error: Get "http://10.134.0.237:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:22:30	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	Unhealthy	Readiness probe failed: Get "http://10.134.0.237:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:22:32 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	Started	Container started
01:22:32 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	Created	Container created
01:22:32 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:22:37 (x5)	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	Unhealthy	Startup probe failed: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused
01:22:37 (x5)	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	ProbeError	Startup probe error: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused body:
01:22:57 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w2-5fedc7-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:22:57 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w2-5fedc7-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:23:15	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-334c6a-579c7f89c5-kftkl	Killing	Stopping container payload-pre-processing
01:23:15	openshift-ingress	kubelet	payload-processing-e2e-autores-334c6a-65568666f7-84f5v	Killing	Stopping container payload-processing
01:23:25	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	Killing	Stopping container istio-proxy
01:23:26	openshift-ingress	deployment-controller	e2e-noten-f24360-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-noten-f24360-openshift-default-c677fb987 from 0 to 1
01:23:26	openshift-ingress	replicaset-controller	e2e-noten-f24360-openshift-default-c677fb987	SuccessfulCreate	Created pod: e2e-noten-f24360-openshift-default-c677fb987-m6z6w
01:23:26	openshift-ingress	gateway_labeler_controller	e2e-noten-f24360	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f24360
01:23:27	openshift-ingress	multus	e2e-noten-f24360-openshift-default-c677fb987-m6z6w	AddedInterface	Add eth0 [10.132.0.167/23] from ovn-kubernetes
01:23:27	openshift-ingress	kubelet	e2e-noten-f24360-openshift-default-c677fb987-m6z6w	Started	Container started
01:23:27	openshift-ingress	kubelet	e2e-noten-f24360-openshift-default-c677fb987-m6z6w	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:23:27	openshift-ingress	kubelet	e2e-noten-f24360-openshift-default-c677fb987-m6z6w	Created	Container created
01:23:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-noten-f24360 namespace
01:23:29	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:23:29	openshift-ingress	kubelet	e2e-autores-334c6a-openshift-default-8659f944c9-n8tpp	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:23:41	openshift-ingress	horizontal-pod-autoscaler	e2e-noten-f24360-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:23:41	openshift-ingress	horizontal-pod-autoscaler	e2e-noten-f24360-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:23:56	openshift-ingress	horizontal-pod-autoscaler	e2e-noten-f24360-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:23:56	openshift-ingress	horizontal-pod-autoscaler	e2e-noten-f24360-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:23:57	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	Killing	Stopping container istio-proxy
01:23:57 (x2)	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 3 to 2
01:23:57 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 2; reason: All metrics below target
01:23:57	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw
01:23:58	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	Killing	Stopping container istio-proxy
01:23:58 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 2; reason: All metrics below target
01:23:58 (x2)	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 3 to 2
01:24:01	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:24:01	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-qj6qr	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:24:01	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:24:01	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-xk4hw	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:24:12	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5	Killing	Stopping container istio-proxy
01:24:12 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w0-902076-openshift-default	SuccessfulRescale	New size: 1; reason: All metrics below target
01:24:12	openshift-ingress	replicaset-controller	e2e-worker-w0-902076-openshift-default-d75675f49	SuccessfulDelete	Deleted pod: e2e-worker-w0-902076-openshift-default-d75675f49-h5vc5
01:24:12 (x3)	openshift-ingress	deployment-controller	e2e-worker-w0-902076-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w0-902076-openshift-default-d75675f49 from 2 to 1
01:24:25	opendatahub	kubelet	test-curl-7460-dc7350	Pulling	Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
01:24:25	opendatahub	multus	test-curl-7460-dc7350	AddedInterface	Add eth0 [10.132.0.169/23] from ovn-kubernetes
01:24:27	opendatahub	kubelet	test-curl-7460-dc7350	Started	Container started
01:24:27	opendatahub	kubelet	test-curl-7460-dc7350	Created	Container created
01:24:27	opendatahub	kubelet	test-curl-7460-dc7350	Pulled	Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.536s (1.536s including waiting). Image size: 106100986 bytes.
01:24:29	opendatahub	kubelet	test-curl-7460-dc7350	Killing	Stopping container test-curl-7460-dc7350
01:24:31	opendatahub	kubelet	test-curl-7460-01317b	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:24:31	opendatahub	kubelet	test-curl-7460-01317b	Created	Container created
01:24:31	opendatahub	multus	test-curl-7460-01317b	AddedInterface	Add eth0 [10.132.0.170/23] from ovn-kubernetes
01:24:31	opendatahub	kubelet	test-curl-7460-01317b	Started	Container started
01:24:34	opendatahub	kubelet	test-curl-7460-22ecbc	Created	Container created
01:24:34	opendatahub	kubelet	test-curl-7460-01317b	Killing	Stopping container test-curl-7460-01317b
01:24:34	opendatahub	multus	test-curl-7460-22ecbc	AddedInterface	Add eth0 [10.133.0.145/23] from ovn-kubernetes
01:24:34	opendatahub	kubelet	test-curl-7460-22ecbc	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:24:34	opendatahub	kubelet	test-curl-7460-22ecbc	Started	Container started
01:24:36	opendatahub	kubelet	test-curl-7460-22ecbc	Killing	Stopping container test-curl-7460-22ecbc
01:24:37	opendatahub	kubelet	test-curl-7460-2bfc55	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:24:37	opendatahub	kubelet	test-curl-7460-2bfc55	Created	Container created
01:24:37	opendatahub	kubelet	test-curl-7460-2bfc55	Started	Container started
01:24:37	opendatahub	multus	test-curl-7460-2bfc55	AddedInterface	Add eth0 [10.133.0.146/23] from ovn-kubernetes
01:24:39	opendatahub	kubelet	test-curl-7460-2bfc55	Killing	Stopping container test-curl-7460-2bfc55
01:24:40	opendatahub	multus	test-curl-7460-ccaebd	AddedInterface	Add eth0 [10.133.0.147/23] from ovn-kubernetes
01:24:40	opendatahub	kubelet	test-curl-7460-ccaebd	Started	Container started
01:24:40	opendatahub	kubelet	test-curl-7460-ccaebd	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:24:40	opendatahub	kubelet	test-curl-7460-ccaebd	Created	Container created
01:24:42	opendatahub	kubelet	test-curl-7460-ccaebd	Killing	Stopping container test-curl-7460-ccaebd
01:24:44	openshift-ingress	gateway_labeler_controller	e2e-extmod-a-51a10e	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-51a10e
01:24:44	openshift-ingress	replicaset-controller	e2e-extmod-a-51a10e-openshift-default-7b49845fcc	SuccessfulCreate	Created pod: e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv
01:24:44	openshift-ingress	deployment-controller	e2e-extmod-a-51a10e-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-extmod-a-51a10e-openshift-default-7b49845fcc from 0 to 1
01:24:45	openshift-ingress	multus	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	AddedInterface	Add eth0 [10.133.0.148/23] from ovn-kubernetes
01:24:49	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-extmod-a-51a10e namespace
01:24:52	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55	SuccessfulCreate	Created pod: payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c
01:24:52 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55	FailedCreate	Error creating: pods "payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-51a10e: serviceaccount "payload-processing-e2e-extmod-a-51a10e" not found
01:24:52	openshift-ingress	deployment-controller	payload-processing-e2e-extmod-a-51a10e	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-extmod-a-51a10e-85d647bb45 from 0 to 1
01:24:52 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-51a10e-85d647bb45	FailedCreate	Error creating: pods "payload-processing-e2e-extmod-a-51a10e-85d647bb45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-51a10e: serviceaccount "payload-processing-e2e-extmod-a-51a10e" not found
01:24:52	openshift-ingress	deployment-controller	payload-pre-processing-e2e-extmod-a-51a10e	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55 from 0 to 1
01:24:52	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-51a10e-85d647bb45	SuccessfulCreate	Created pod: payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc
01:24:53	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:24:53	openshift-ingress	multus	payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c	AddedInterface	Add eth0 [10.133.0.150/23] from ovn-kubernetes
01:24:53	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:24:53	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc	Started	Container started
01:24:53	openshift-ingress	multus	payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc	AddedInterface	Add eth0 [10.133.0.151/23] from ovn-kubernetes
01:24:53	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c	Started	Container started
01:24:53	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c	Created	Container created
01:24:53	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc	Created	Container created
01:25:10	openshift-ingress	kubelet	e2e-noten-f24360-openshift-default-c677fb987-m6z6w	Killing	Stopping container istio-proxy
01:25:14	openshift-ingress	kubelet	e2e-noten-f24360-openshift-default-c677fb987-m6z6w	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:25:14	openshift-ingress	kubelet	e2e-noten-f24360-openshift-default-c677fb987-m6z6w	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:25:15	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 4 to 3
01:25:15	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	SuccessfulRescale	New size: 3; reason: All metrics below target
01:25:15	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	Killing	Stopping container istio-proxy
01:25:15	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulDelete	Deleted pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl
01:25:18	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:25:18	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-m2rkl	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:25:30	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulDelete	Deleted pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4
01:25:30	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 3 to 2
01:25:30	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	SuccessfulRescale	New size: 2; reason: All metrics below target
01:25:30	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	Killing	Stopping container istio-proxy
01:25:36	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	ProbeError	Readiness probe error: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:25:36	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-ffjm4	Unhealthy	Readiness probe failed: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:25:55	openshift-ingress	deployment-controller	e2e-extmod-a-da4e92-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-extmod-a-da4e92-openshift-default-5dcd9fb765 from 0 to 1
01:25:55	openshift-ingress	replicaset-controller	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765	SuccessfulCreate	Created pod: e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn
01:25:55	openshift-ingress	gateway_labeler_controller	e2e-extmod-a-da4e92	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-da4e92
01:25:55	openshift-ingress	multus	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	AddedInterface	Add eth0 [10.134.0.241/23] from ovn-kubernetes
01:26:00	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-extmod-a-da4e92 namespace
01:26:02	opendatahub	kubelet	test-curl-7466-190204	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:26:02	opendatahub	kubelet	test-curl-7466-190204	Started	Container started
01:26:02	opendatahub	multus	test-curl-7466-190204	AddedInterface	Add eth0 [10.132.0.174/23] from ovn-kubernetes
01:26:02	opendatahub	kubelet	test-curl-7466-190204	Created	Container created
01:26:03 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-da4e92-56d5774b49	FailedCreate	Error creating: pods "payload-processing-e2e-extmod-a-da4e92-56d5774b49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-da4e92: serviceaccount "payload-processing-e2e-extmod-a-da4e92" not found
01:26:03	openshift-ingress	deployment-controller	payload-pre-processing-e2e-extmod-a-da4e92	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c from 0 to 1
01:26:03	openshift-ingress	deployment-controller	payload-processing-e2e-extmod-a-da4e92	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-extmod-a-da4e92-56d5774b49 from 0 to 1
01:26:03 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-da4e92: serviceaccount "payload-processing-e2e-extmod-a-da4e92" not found
01:26:04	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv
01:26:04	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:26:04	openshift-ingress	multus	payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq	AddedInterface	Add eth0 [10.133.0.156/23] from ovn-kubernetes
01:26:04	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-da4e92-56d5774b49	SuccessfulCreate	Created pod: payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq
01:26:04	opendatahub	kubelet	test-curl-7466-190204	Killing	Stopping container test-curl-7466-190204
01:26:05	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq	Started	Container started
01:26:05	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq	Created	Container created
01:26:05	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv	Created	Container created
01:26:05	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv	Started	Container started
01:26:05	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:26:05	openshift-ingress	multus	payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv	AddedInterface	Add eth0 [10.133.0.155/23] from ovn-kubernetes
01:26:06	openshift-ingress	deployment-controller	e2e-extmod-a-a7f221-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-extmod-a-a7f221-openshift-default-79b49b4d65 from 0 to 1
01:26:06	openshift-ingress	multus	e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	AddedInterface	Add eth0 [10.134.0.242/23] from ovn-kubernetes
01:26:06	openshift-ingress	replicaset-controller	e2e-extmod-a-a7f221-openshift-default-79b49b4d65	SuccessfulCreate	Created pod: e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq
01:26:06	openshift-ingress	gateway_labeler_controller	e2e-extmod-a-a7f221	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a7f221
01:26:08	openshift-ingress	replicaset-controller	e2e-extmod-a-5edd34-openshift-default-5677657d77	SuccessfulCreate	Created pod: e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf
01:26:08	openshift-ingress	deployment-controller	e2e-extmod-a-5edd34-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-extmod-a-5edd34-openshift-default-5677657d77 from 0 to 1
01:26:08	openshift-ingress	gateway_labeler_controller	e2e-extmod-a-5edd34	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-5edd34
01:26:09	openshift-ingress	multus	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	AddedInterface	Add eth0 [10.133.0.157/23] from ovn-kubernetes
01:26:10	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-extmod-a-a7f221 namespace
01:26:13	openshift-ingress	deployment-controller	payload-processing-e2e-extmod-a-a7f221	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-extmod-a-a7f221-6648dfb8b9 from 0 to 1
01:26:13	openshift-ingress	deployment-controller	payload-pre-processing-e2e-extmod-a-a7f221	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c from 0 to 1
01:26:14 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 1; reason: All metrics below target
01:26:14	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 2 to 1
01:26:14 (x9)	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulDelete	(combined from similar events): Deleted pod: e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps
01:26:14	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	Killing	Stopping container istio-proxy
01:26:14 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-a7f221-6648dfb8b9	FailedCreate	Error creating: pods "payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a7f221: serviceaccount "payload-processing-e2e-extmod-a-a7f221" not found
01:26:14	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-extmod-a-5edd34 namespace
01:26:14	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-a7f221-6648dfb8b9	SuccessfulCreate	Created pod: payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl
01:26:14	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc
01:26:14 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a7f221: serviceaccount "payload-processing-e2e-extmod-a-a7f221" not found
01:26:14	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:26:14	openshift-ingress	multus	payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc	AddedInterface	Add eth0 [10.132.0.175/23] from ovn-kubernetes
01:26:15	openshift-ingress	multus	payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl	AddedInterface	Add eth0 [10.132.0.176/23] from ovn-kubernetes
01:26:15	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl	Created	Container created
01:26:15	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl	Started	Container started
01:26:15	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:26:15	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc	Created	Container created
01:26:15	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc	Started	Container started
01:26:17	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:26:17	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-d9zps	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:26:18 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c	FailedCreate	Error creating: pods "payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-5edd34: serviceaccount "payload-processing-e2e-extmod-a-5edd34" not found
01:26:18 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95	FailedCreate	Error creating: pods "payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-5edd34: serviceaccount "payload-processing-e2e-extmod-a-5edd34" not found
01:26:18	openshift-ingress	deployment-controller	payload-pre-processing-e2e-extmod-a-5edd34	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95 from 0 to 1
01:26:18	openshift-ingress	deployment-controller	payload-processing-e2e-extmod-a-5edd34	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c from 0 to 1
01:26:19	openshift-ingress	multus	payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx	AddedInterface	Add eth0 [10.132.0.177/23] from ovn-kubernetes
01:26:19	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx	Started	Container started
01:26:19	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c	SuccessfulCreate	Created pod: payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj
01:26:19	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx	Created	Container created
01:26:19	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95	SuccessfulCreate	Created pod: payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx
01:26:19	openshift-ingress	multus	payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj	AddedInterface	Add eth0 [10.134.0.243/23] from ovn-kubernetes
01:26:19	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:26:20	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj	Started	Container started
01:26:20	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj	Created	Container created
01:26:20	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:26:32 (x2)	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:26:32 (x2)	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	Started	Container started
01:26:32 (x2)	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	Created	Container created
01:26:32	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	Unhealthy	Readiness probe failed: Get "http://10.133.0.148:15021/healthz/ready": read tcp 10.133.0.2:56724->10.133.0.148:15021: read: connection reset by peer
01:26:32	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	ProbeError	Readiness probe error: Get "http://10.133.0.148:15021/healthz/ready": read tcp 10.133.0.2:56724->10.133.0.148:15021: read: connection reset by peer body:
01:26:38 (x5)	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	ProbeError	Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:
01:26:38 (x5)	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	Unhealthy	Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused
01:26:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-51a10e-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:26:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-51a10e-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:27:00	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-51a10e-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:27:00	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-51a10e-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:27:24	openshift-ingress	gateway_labeler_controller	e2e-extmod-b-8d18a8	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-8d18a8
01:27:24	openshift-ingress	deployment-controller	e2e-extmod-b-8d18a8-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-extmod-b-8d18a8-openshift-default-6b86965dc7 from 0 to 1
01:27:24	openshift-ingress	replicaset-controller	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7	SuccessfulCreate	Created pod: e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv
01:27:25	openshift-ingress	multus	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	AddedInterface	Add eth0 [10.134.0.244/23] from ovn-kubernetes
01:27:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-extmod-b-8d18a8 namespace
01:27:32	openshift-ingress	deployment-controller	payload-pre-processing-e2e-extmod-b-8d18a8	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f from 0 to 1
01:27:32	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc	SuccessfulCreate	Created pod: payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl
01:27:32 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f	FailedCreate	Error creating: pods "payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8d18a8: serviceaccount "payload-processing-e2e-extmod-b-8d18a8" not found
01:27:32 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc	FailedCreate	Error creating: pods "payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8d18a8: serviceaccount "payload-processing-e2e-extmod-b-8d18a8" not found
01:27:32	openshift-ingress	deployment-controller	payload-processing-e2e-extmod-b-8d18a8	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc from 0 to 1
01:27:33	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl	Started	Container started
01:27:33	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f	SuccessfulCreate	Created pod: payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh
01:27:33	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:27:33	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh	Created	Container created
01:27:33	openshift-ingress	multus	payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh	AddedInterface	Add eth0 [10.133.0.159/23] from ovn-kubernetes
01:27:33	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl	Created	Container created
01:27:33	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh	Started	Container started
01:27:33	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:27:33	openshift-ingress	multus	payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl	AddedInterface	Add eth0 [10.133.0.158/23] from ovn-kubernetes
01:27:44	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	Unhealthy	Readiness probe failed: Get "http://10.134.0.241:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:27:44	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	ProbeError	Readiness probe error: Get "http://10.134.0.241:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:27:45 (x2)	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	Started	Container started
01:27:45 (x2)	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:27:45 (x2)	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	Created	Container created
01:27:50 (x5)	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	Unhealthy	Startup probe failed: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused
01:27:50 (x5)	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	ProbeError	Startup probe error: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused body:
01:27:56 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-da4e92-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:27:56 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-da4e92-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:28:11	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-da4e92-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:28:11	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-da4e92-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:28:19 (x2)	openshift-ingress	kubelet	e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	Created	Container created
01:28:19 (x2)	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	Created	Container created
01:28:19 (x2)	openshift-ingress	kubelet	e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	Started	Container started
01:28:19 (x2)	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:28:19 (x2)	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	Started	Container started
01:28:19 (x2)	openshift-ingress	kubelet	e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:28:22	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-a7f221-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:28:22	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-a7f221-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:28:24 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-5edd34-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:28:24 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-5edd34-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:28:25 (x6)	openshift-ingress	kubelet	e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	ProbeError	Startup probe error: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused body:
01:28:25 (x5)	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	Unhealthy	Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused
01:28:25 (x5)	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	ProbeError	Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:
01:28:25 (x6)	openshift-ingress	kubelet	e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	Unhealthy	Startup probe failed: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused
01:28:40	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-5edd34-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:28:40	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-5edd34-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:28:44	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulDelete	Deleted pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq
01:28:44	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	Killing	Stopping container istio-proxy
01:28:44	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	(combined from similar events): New size: 1; reason: All metrics below target
01:28:44	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	(combined from similar events): Scaled down replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 2 to 1
01:28:45	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:28:45	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-hgdmq	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:28:52 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-a7f221-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:28:52 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-a7f221-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:28:56	openshift-ingress	replicaset-controller	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f	SuccessfulCreate	Created pod: e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv
01:28:56	openshift-ingress	deployment-controller	e2e-extmod-b-96b6c2-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f from 0 to 1
01:28:56	openshift-ingress	gateway_labeler_controller	e2e-extmod-b-96b6c2	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-96b6c2
01:28:57	openshift-ingress	multus	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	AddedInterface	Add eth0 [10.133.0.160/23] from ovn-kubernetes
01:29:00	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-extmod-b-96b6c2 namespace
01:29:03	opendatahub	multus	test-curl-7463-f4cf17	AddedInterface	Add eth0 [10.133.0.162/23] from ovn-kubernetes
01:29:03 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-b-96b6c2-5c846f5865	FailedCreate	Error creating: pods "payload-processing-e2e-extmod-b-96b6c2-5c846f5865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-96b6c2: serviceaccount "payload-processing-e2e-extmod-b-96b6c2" not found
01:29:03	opendatahub	kubelet	test-curl-7463-f4cf17	Created	Container created
01:29:03	openshift-ingress	deployment-controller	payload-processing-e2e-extmod-b-96b6c2	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-extmod-b-96b6c2-5c846f5865 from 0 to 1
01:29:03	opendatahub	kubelet	test-curl-7463-f4cf17	Started	Container started
01:29:03 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f	FailedCreate	Error creating: pods "payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-96b6c2: serviceaccount "payload-processing-e2e-extmod-b-96b6c2" not found
01:29:03	opendatahub	kubelet	test-curl-7463-f4cf17	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:29:03	openshift-ingress	deployment-controller	payload-pre-processing-e2e-extmod-b-96b6c2	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f from 0 to 1
01:29:04	openshift-ingress	multus	payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj	AddedInterface	Add eth0 [10.134.0.246/23] from ovn-kubernetes
01:29:04	openshift-ingress	multus	payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc	AddedInterface	Add eth0 [10.134.0.245/23] from ovn-kubernetes
01:29:04	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:29:04	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-b-96b6c2-5c846f5865	SuccessfulCreate	Created pod: payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj
01:29:04	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc	Created	Container created
01:29:04	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc	Started	Container started
01:29:04	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f	SuccessfulCreate	Created pod: payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc
01:29:05	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj	Started	Container started
01:29:05	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj	Created	Container created
01:29:05	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:29:06	opendatahub	kubelet	test-curl-7463-f4cf17	Killing	Stopping container test-curl-7463-f4cf17
01:29:15	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-a7f221-6648dfb8b9-5sqcl	Killing	Stopping container payload-processing
01:29:15	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-a7f221-7bbf68d76c-mzjvc	Killing	Stopping container payload-pre-processing
01:29:18	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-5edd34-58bf9ccb5c-bdmkj	Killing	Stopping container payload-processing
01:29:18	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-5edd34-746bf94f95-5zxdx	Killing	Stopping container payload-pre-processing
01:29:28	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Unhealthy	Readiness probe failed: Get "http://10.134.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:29:28	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	ProbeError	Readiness probe error: Get "http://10.134.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:29:30 (x2)	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Started	Container started
01:29:30 (x2)	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:29:30 (x2)	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Created	Container created
01:29:35 (x5)	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	ProbeError	Startup probe error: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused body:
01:29:35 (x5)	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Unhealthy	Startup probe failed: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused
01:29:35	openshift-ingress	gateway_labeler_controller	e2e-explicit-c9ce9a	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c9ce9a
01:29:35	openshift-ingress	replicaset-controller	e2e-explicit-c9ce9a-openshift-default-65d5748b77	SuccessfulCreate	Created pod: e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b
01:29:35	openshift-ingress	deployment-controller	e2e-explicit-c9ce9a-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-explicit-c9ce9a-openshift-default-65d5748b77 from 0 to 1
01:29:36	openshift-ingress	multus	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	AddedInterface	Add eth0 [10.134.0.247/23] from ovn-kubernetes
01:29:40	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-explicit-c9ce9a namespace
01:29:43 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447	FailedCreate	Error creating: pods "payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c9ce9a: serviceaccount "payload-processing-e2e-explicit-c9ce9a" not found
01:29:43	openshift-ingress	deployment-controller	payload-pre-processing-e2e-explicit-c9ce9a	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447 from 0 to 1
01:29:43	openshift-ingress	deployment-controller	payload-processing-e2e-explicit-c9ce9a	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-explicit-c9ce9a-6fc7948b89 from 0 to 1
01:29:43 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-explicit-c9ce9a-6fc7948b89	FailedCreate	Error creating: pods "payload-processing-e2e-explicit-c9ce9a-6fc7948b89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c9ce9a: serviceaccount "payload-processing-e2e-explicit-c9ce9a" not found
01:29:44	openshift-ingress	multus	payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd	AddedInterface	Add eth0 [10.134.0.249/23] from ovn-kubernetes
01:29:44	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447	SuccessfulCreate	Created pod: payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2
01:29:44	openshift-ingress	replicaset-controller	payload-processing-e2e-explicit-c9ce9a-6fc7948b89	SuccessfulCreate	Created pod: payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd
01:29:45	openshift-ingress	kubelet	payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd	Started	Container started
01:29:45	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2	Started	Container started
01:29:45	openshift-ingress	kubelet	payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd	Created	Container created
01:29:45	openshift-ingress	kubelet	payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:29:45	openshift-ingress	multus	payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2	AddedInterface	Add eth0 [10.134.0.248/23] from ovn-kubernetes
01:29:45	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:29:45	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2	Created	Container created
01:30:10 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-b-8d18a8-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:30:10 (x5)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-b-8d18a8-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:30:33	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-51a10e-86475f6b55-hh89c	Killing	Stopping container payload-pre-processing
01:30:33	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-51a10e-85d647bb45-f52xc	Killing	Stopping container payload-processing
01:31:05 (x2)	openshift-ingress	kubelet	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	Started	Container started
01:31:05 (x2)	openshift-ingress	kubelet	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:31:05 (x2)	openshift-ingress	kubelet	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	Created	Container created
01:31:11 (x6)	openshift-ingress	kubelet	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	Unhealthy	Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
01:31:11 (x6)	openshift-ingress	kubelet	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	ProbeError	Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:
01:31:12 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-b-96b6c2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:31:12 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-b-96b6c2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:31:15	openshift-ingress	deployment-controller	e2e-shared-a-w4-27fc07-openshift-default	ScalingReplicaSet	Scaled down replica set e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf from 2 to 1
01:31:15	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	Killing	Stopping container istio-proxy
01:31:15	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w4-27fc07-openshift-default	SuccessfulRescale	New size: 1; reason: All metrics below target
01:31:15	openshift-ingress	replicaset-controller	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf	SuccessfulDelete	Deleted pod: e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2
01:31:18	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:31:18	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-wp4z2	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:31:27	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-b-96b6c2-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:31:27	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-b-96b6c2-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:31:39	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	Unhealthy	Readiness probe failed: Get "http://10.134.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:31:39	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	ProbeError	Readiness probe error: Get "http://10.134.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:31:41 (x2)	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:31:41 (x2)	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	Started	Container started
01:31:41 (x2)	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	Created	Container created
01:31:47 (x5)	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	Unhealthy	Startup probe failed: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused
01:31:47 (x5)	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	ProbeError	Startup probe error: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused body:
01:32:01	openshift-ingress	kubelet	e2e-extmod-a-51a10e-openshift-default-7b49845fcc-xnpbv	Killing	Stopping container istio-proxy
01:32:06 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-explicit-c9ce9a-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:32:06 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-explicit-c9ce9a-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:32:06	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-da4e92-56d5774b49-q4bcq	Killing	Stopping container payload-processing
01:32:07	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-da4e92-58c78dcf8c-f68sv	Killing	Stopping container payload-pre-processing
01:32:09	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-8d18a8-5f6d87ddfc-9jbtl	Killing	Stopping container payload-processing
01:32:09	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-8d18a8-597c97477f-bmlbh	Killing	Stopping container payload-pre-processing
01:32:21	openshift-ingress	kubelet	e2e-extmod-a-a7f221-openshift-default-79b49b4d65-d6kpq	Killing	Stopping container istio-proxy
01:32:22	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	Killing	Stopping container istio-proxy
01:32:22 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-explicit-c9ce9a-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:32:22 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-explicit-c9ce9a-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:32:26	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:32:26	openshift-ingress	kubelet	e2e-extmod-a-5edd34-openshift-default-5677657d77-gzdjf	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:32:47	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-c9ce9a-84bf7f4447-fhrj2	Killing	Stopping container payload-pre-processing
01:32:47	openshift-ingress	kubelet	payload-processing-e2e-explicit-c9ce9a-6fc7948b89-2ljsd	Killing	Stopping container payload-processing
01:32:55	openshift-ingress	kubelet	e2e-explicit-c9ce9a-openshift-default-65d5748b77-5zf7b	Killing	Stopping container istio-proxy
01:32:57	openshift-ingress	replicaset-controller	e2e-extmod-a-3e87a1-openshift-default-786d5974b9	SuccessfulCreate	Created pod: e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g
01:32:57	openshift-ingress	deployment-controller	e2e-extmod-a-3e87a1-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-extmod-a-3e87a1-openshift-default-786d5974b9 from 0 to 1
01:32:57	openshift-ingress	gateway_labeler_controller	e2e-extmod-a-3e87a1	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-3e87a1
01:32:58	openshift-ingress	multus	e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	AddedInterface	Add eth0 [10.133.0.178/23] from ovn-kubernetes
01:33:00	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:33:00	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-6cf6c
01:33:00	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 1 to 2
01:33:01	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	Started	Container started
01:33:01	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	Created	Container created
01:33:01	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:33:01	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	AddedInterface	Add eth0 [10.133.0.179/23] from ovn-kubernetes
01:33:02	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-extmod-a-3e87a1 namespace
01:33:05	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-3e87a1-76c5f8b849	SuccessfulCreate	Created pod: payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q
01:33:05	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999	SuccessfulCreate	Created pod: payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj
01:33:05 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-extmod-a-3e87a1-76c5f8b849	FailedCreate	Error creating: pods "payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3e87a1: serviceaccount "payload-processing-e2e-extmod-a-3e87a1" not found
01:33:05	openshift-ingress	deployment-controller	payload-processing-e2e-extmod-a-3e87a1	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-extmod-a-3e87a1-76c5f8b849 from 0 to 1
01:33:05	openshift-ingress	deployment-controller	payload-pre-processing-e2e-extmod-a-3e87a1	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999 from 0 to 1
01:33:05 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999	FailedCreate	Error creating: pods "payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3e87a1: serviceaccount "payload-processing-e2e-extmod-a-3e87a1" not found
01:33:06	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj	Started	Container started
01:33:06	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q	Created	Container created
01:33:06	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q	Started	Container started
01:33:06	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj	Created	Container created
01:33:06	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:33:06	openshift-ingress	multus	payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj	AddedInterface	Add eth0 [10.133.0.180/23] from ovn-kubernetes
01:33:06	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:33:06	openshift-ingress	multus	payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q	AddedInterface	Add eth0 [10.134.1.4/23] from ovn-kubernetes
01:33:09 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	ProbeError	Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
01:33:09 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	Unhealthy	Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
01:33:27	openshift-ingress	kubelet	e2e-extmod-a-da4e92-openshift-default-5dcd9fb765-qkrmn	Killing	Stopping container istio-proxy
01:33:30	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 2 to 4
01:33:30	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-7lvhw
01:33:30	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-p79k2
01:33:31	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Started	Container started
01:33:31	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	AddedInterface	Add eth0 [10.132.0.183/23] from ovn-kubernetes
01:33:31	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Created	Container created
01:33:31	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:33:31	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	AddedInterface	Add eth0 [10.133.0.182/23] from ovn-kubernetes
01:33:32	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	Started	Container started
01:33:32	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:33:32	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	Created	Container created
01:33:34	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Killing	Stopping container istio-proxy
01:33:35	openshift-ingress	kubelet	payload-processing-e2e-extmod-b-96b6c2-5c846f5865-md8cj	Killing	Stopping container payload-processing
01:33:35	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-b-96b6c2-6f87c54c5f-76jdc	Killing	Stopping container payload-pre-processing
01:33:36	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:33:36	openshift-ingress	kubelet	e2e-extmod-b-8d18a8-openshift-default-6b86965dc7-77lnv	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:33:39 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	ProbeError	Startup probe error: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused body:
01:33:39 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Unhealthy	Startup probe failed: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused
01:33:39 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	Unhealthy	Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
01:33:39 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	ProbeError	Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
01:33:49	openshift-ingress	gateway_labeler_controller	e2e-inf-a-8741da	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-8741da
01:33:49	openshift-ingress	replicaset-controller	e2e-inf-a-8741da-openshift-default-5796f4f49c	SuccessfulCreate	Created pod: e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv
01:33:49	openshift-ingress	deployment-controller	e2e-inf-a-8741da-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-8741da-openshift-default-5796f4f49c from 0 to 1
01:33:50	openshift-ingress	multus	e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	AddedInterface	Add eth0 [10.133.0.183/23] from ovn-kubernetes
01:33:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-a-8741da namespace
01:33:58 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-8741da-78dfdf54c9	FailedCreate	Error creating: pods "payload-processing-e2e-inf-a-8741da-78dfdf54c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8741da: serviceaccount "payload-processing-e2e-inf-a-8741da" not found
01:33:58 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-8741da-5d66f5844c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8741da: serviceaccount "payload-processing-e2e-inf-a-8741da" not found
01:33:58	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-8741da-5d66f5844c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67
01:33:58	openshift-ingress	deployment-controller	payload-processing-e2e-inf-a-8741da	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-a-8741da-78dfdf54c9 from 0 to 1
01:33:58	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-a-8741da	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-a-8741da-5d66f5844c from 0 to 1
01:33:58	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-8741da-78dfdf54c9	SuccessfulCreate	Created pod: payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k
01:33:59	openshift-ingress	multus	payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k	AddedInterface	Add eth0 [10.134.1.10/23] from ovn-kubernetes
01:33:59	openshift-ingress	kubelet	payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:33:59	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67	Created	Container created
01:33:59	openshift-ingress	kubelet	payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k	Created	Container created
01:33:59	openshift-ingress	kubelet	payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k	Started	Container started
01:33:59	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:33:59	openshift-ingress	multus	payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67	AddedInterface	Add eth0 [10.134.1.9/23] from ovn-kubernetes
01:33:59	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67	Started	Container started
01:34:02	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	ProbeError	Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:34:02	openshift-ingress	gateway_labeler_controller	e2e-inf-a-a85846	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a85846
01:34:02	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	Unhealthy	Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:34:04	openshift-ingress	replicaset-controller	e2e-inf-a-a85846-openshift-default-6c946d9dbc	SuccessfulCreate	Created pod: e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb
01:34:04	openshift-ingress	multus	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	AddedInterface	Add eth0 [10.134.1.12/23] from ovn-kubernetes
01:34:04	openshift-ingress	deployment-controller	e2e-inf-a-a85846-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-a85846-openshift-default-6c946d9dbc from 0 to 1
01:34:08	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-a-a85846 namespace
01:34:11	openshift-ingress	deployment-controller	payload-processing-e2e-inf-a-a85846	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-a-a85846-6d9d4fc9b5 from 0 to 1
01:34:11	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-a-a85846	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995 from 0 to 1
01:34:12 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-a85846-6d9d4fc9b5	FailedCreate	Error creating: pods "payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a85846: serviceaccount "payload-processing-e2e-inf-a-a85846" not found
01:34:12	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-a85846-6d9d4fc9b5	SuccessfulCreate	Created pod: payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz
01:34:12	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7
01:34:12 (x7)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a85846: serviceaccount "payload-processing-e2e-inf-a-a85846" not found
01:34:13	openshift-ingress	multus	payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz	AddedInterface	Add eth0 [10.134.1.14/23] from ovn-kubernetes
01:34:13	openshift-ingress	kubelet	payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:34:13	openshift-ingress	kubelet	payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz	Started	Container started
01:34:13	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7	Started	Container started
01:34:13	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7	Created	Container created
01:34:13	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:34:13	openshift-ingress	kubelet	payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz	Created	Container created
01:34:13	openshift-ingress	multus	payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7	AddedInterface	Add eth0 [10.133.0.184/23] from ovn-kubernetes
01:34:15	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-pl9jb
01:34:15	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-dqmwg
01:34:15	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 7; reason: cpu resource utilization (percentage of request) above target
01:34:15	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 4 to 7
01:34:15	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-btqmg
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Started	Container started
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Started	Container started
01:34:16	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	AddedInterface	Add eth0 [10.133.0.185/23] from ovn-kubernetes
01:34:16	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	AddedInterface	Add eth0 [10.132.0.184/23] from ovn-kubernetes
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	Created	Container created
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Created	Container created
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	Started	Container started
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Created	Container created
01:34:16	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:34:16	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	AddedInterface	Add eth0 [10.134.1.15/23] from ovn-kubernetes
01:34:24 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Unhealthy	Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused
01:34:24 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	ProbeError	Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
01:34:24 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	Unhealthy	Startup probe failed: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused
01:34:24 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	ProbeError	Startup probe error: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused body:
01:34:24 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Unhealthy	Startup probe failed: Get "http://10.134.1.15:15021/healthz/ready": dial tcp 10.134.1.15:15021: connect: connection refused
01:34:24 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	ProbeError	Startup probe error: Get "http://10.134.1.15:15021/healthz/ready": dial tcp 10.134.1.15:15021: connect: connection refused body:
01:34:57 (x2)	openshift-ingress	kubelet	e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:34:58 (x2)	openshift-ingress	kubelet	e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	Started	Container started
01:34:58 (x2)	openshift-ingress	kubelet	e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	Created	Container created
01:35:00	openshift-ingress	kubelet	e2e-extmod-b-96b6c2-openshift-default-5f8d4b498f-69vzv	Killing	Stopping container istio-proxy
01:35:01	openshift-ingress	gateway_labeler_controller	e2e-inf-a-009c48	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-009c48
01:35:03 (x5)	openshift-ingress	kubelet	e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	Unhealthy	Startup probe failed: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused
01:35:03 (x5)	openshift-ingress	kubelet	e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	ProbeError	Startup probe error: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused body:
01:35:04	openshift-ingress	replicaset-controller	e2e-inf-a-009c48-openshift-default-77bf58896c	SuccessfulCreate	Created pod: e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4
01:35:04	openshift-ingress	deployment-controller	e2e-inf-a-009c48-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-009c48-openshift-default-77bf58896c from 0 to 1
01:35:05	openshift-ingress	multus	e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	AddedInterface	Add eth0 [10.134.1.16/23] from ovn-kubernetes
01:35:08	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-a-009c48 namespace
01:35:13 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-009c48-8595685bbc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-a-009c48-8595685bbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-009c48: serviceaccount "payload-processing-e2e-inf-a-009c48" not found
01:35:13	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-a-009c48	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-a-009c48-8595685bbc from 0 to 1
01:35:13	openshift-ingress	deployment-controller	payload-processing-e2e-inf-a-009c48	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-a-009c48-766cfc7669 from 0 to 1
01:35:13 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-009c48-766cfc7669	FailedCreate	Error creating: pods "payload-processing-e2e-inf-a-009c48-766cfc7669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-009c48: serviceaccount "payload-processing-e2e-inf-a-009c48" not found
01:35:14 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-3e87a1-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:35:14	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:35:14	openshift-ingress	multus	payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr	AddedInterface	Add eth0 [10.133.0.186/23] from ovn-kubernetes
01:35:14	openshift-ingress	multus	payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r	AddedInterface	Add eth0 [10.133.0.187/23] from ovn-kubernetes
01:35:14	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-009c48-766cfc7669	SuccessfulCreate	Created pod: payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r
01:35:14 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-3e87a1-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:35:14	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-009c48-8595685bbc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr
01:35:15	openshift-ingress	kubelet	payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:35:15	openshift-ingress	kubelet	payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r	Started	Container started
01:35:15	openshift-ingress	kubelet	payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r	Created	Container created
01:35:15	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr	Started	Container started
01:35:15	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr	Created	Container created
01:35:29 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-3e87a1-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:35:29 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-extmod-a-3e87a1-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:35:45 (x2)	openshift-ingress	kubelet	e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	Started	Container started
01:35:45 (x2)	openshift-ingress	kubelet	e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	Created	Container created
01:35:45 (x2)	openshift-ingress	kubelet	e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:35:51 (x5)	openshift-ingress	kubelet	e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	ProbeError	Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:
01:35:51 (x5)	openshift-ingress	kubelet	e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	Unhealthy	Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused
01:36:04 (x2)	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	Created	Container created
01:36:04 (x2)	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:36:04 (x2)	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	Started	Container started
01:36:05 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-8741da-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:36:05 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-8741da-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:36:08	openshift-ingress	kubelet	payload-pre-processing-e2e-extmod-a-3e87a1-5dd665c999-ghgwj	Killing	Stopping container payload-pre-processing
01:36:08	openshift-ingress	kubelet	payload-processing-e2e-extmod-a-3e87a1-76c5f8b849-trr7q	Killing	Stopping container payload-processing
01:36:09 (x5)	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	Unhealthy	Startup probe failed: Get "http://10.134.1.12:15021/healthz/ready": dial tcp 10.134.1.12:15021: connect: connection refused
01:36:09 (x5)	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	ProbeError	Startup probe error: Get "http://10.134.1.12:15021/healthz/ready": dial tcp 10.134.1.12:15021: connect: connection refused body:
01:36:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-a85846-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:36:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-a85846-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:36:21 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-8741da-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:36:21 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-8741da-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:36:35 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-a85846-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:36:35 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-a85846-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:36:49	openshift-ingress	replicaset-controller	e2e-inf-b-d4c457-openshift-default-56698d568c	SuccessfulCreate	Created pod: e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg
01:36:49	openshift-ingress	deployment-controller	e2e-inf-b-d4c457-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-d4c457-openshift-default-56698d568c from 0 to 1
01:36:49	openshift-ingress	gateway_labeler_controller	e2e-inf-b-d4c457	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d4c457
01:36:50	openshift-ingress	multus	e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	AddedInterface	Add eth0 [10.133.0.188/23] from ovn-kubernetes
01:36:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-b-d4c457 namespace
01:36:58	openshift-ingress	deployment-controller	payload-processing-e2e-inf-b-d4c457	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-b-d4c457-54656b5fd9 from 0 to 1
01:36:59	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-d4c457-54656b5fd9	SuccessfulCreate	Created pod: payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86
01:36:59 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-d4c457-54656b5fd9	FailedCreate	Error creating: pods "payload-processing-e2e-inf-b-d4c457-54656b5fd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d4c457: serviceaccount "payload-processing-e2e-inf-b-d4c457" not found
01:36:59	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-d4c457-6465889bc9	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf
01:36:59 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-d4c457-6465889bc9	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d4c457: serviceaccount "payload-processing-e2e-inf-b-d4c457" not found
01:36:59	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-b-d4c457	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-b-d4c457-6465889bc9 from 0 to 1
01:37:00	openshift-ingress	multus	payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf	AddedInterface	Add eth0 [10.133.0.189/23] from ovn-kubernetes
01:37:00	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:37:00	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf	Created	Container created
01:37:00	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf	Started	Container started
01:37:00	openshift-ingress	multus	payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86	AddedInterface	Add eth0 [10.133.0.190/23] from ovn-kubernetes
01:37:00	openshift-ingress	kubelet	payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:37:00	openshift-ingress	kubelet	payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86	Created	Container created
01:37:00	openshift-ingress	kubelet	payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86	Started	Container started
01:37:07 (x2)	openshift-ingress	kubelet	e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	Started	Container started
01:37:07 (x2)	openshift-ingress	kubelet	e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:37:07 (x2)	openshift-ingress	kubelet	e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	Created	Container created
01:37:12	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-a85846-6dbf8f9995-jjqn7	Killing	Stopping container payload-pre-processing
01:37:12	openshift-ingress	kubelet	payload-processing-e2e-inf-a-a85846-6d9d4fc9b5-kndnz	Killing	Stopping container payload-processing
01:37:13 (x6)	openshift-ingress	kubelet	e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	Unhealthy	Startup probe failed: Get "http://10.134.1.16:15021/healthz/ready": dial tcp 10.134.1.16:15021: connect: connection refused
01:37:13 (x6)	openshift-ingress	kubelet	e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	ProbeError	Startup probe error: Get "http://10.134.1.16:15021/healthz/ready": dial tcp 10.134.1.16:15021: connect: connection refused body:
01:37:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-009c48-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:37:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-009c48-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:37:26	openshift-ingress	kubelet	e2e-extmod-a-3e87a1-openshift-default-786d5974b9-s695g	Killing	Stopping container istio-proxy
01:37:50 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-009c48-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:37:50 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-009c48-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:38:11	openshift-ingress	gateway_labeler_controller	e2e-inf-a-b8f252	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-b8f252
01:38:12	openshift-ingress	replicaset-controller	e2e-inf-a-b8f252-openshift-default-54b89bd66f	SuccessfulCreate	Created pod: e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp
01:38:12	openshift-ingress	deployment-controller	e2e-inf-a-b8f252-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-b8f252-openshift-default-54b89bd66f from 0 to 1
01:38:13	openshift-ingress	multus	e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	AddedInterface	Add eth0 [10.133.0.193/23] from ovn-kubernetes
01:38:16	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-009c48-8595685bbc-5g8mr	Killing	Stopping container payload-pre-processing
01:38:16	openshift-ingress	kubelet	payload-processing-e2e-inf-a-009c48-766cfc7669-x2v5r	Killing	Stopping container payload-processing
01:38:17	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-a-b8f252 namespace
01:38:17	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-44k5r
01:38:17	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-8qhvg
01:38:17	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 7 to 10
01:38:17	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-jfkxg
01:38:18	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	AddedInterface	Add eth0 [10.132.0.189/23] from ovn-kubernetes
01:38:18	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	AddedInterface	Add eth0 [10.134.1.18/23] from ovn-kubernetes
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Created	Container created
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Started	Container started
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Created	Container created
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Started	Container started
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Started	Container started
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Created	Container created
01:38:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:38:18	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	AddedInterface	Add eth0 [10.134.1.19/23] from ovn-kubernetes
01:38:20 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-b8f252-65ffcc7559	FailedCreate	Error creating: pods "payload-processing-e2e-inf-a-b8f252-65ffcc7559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b8f252: serviceaccount "payload-processing-e2e-inf-a-b8f252" not found
01:38:20	openshift-ingress	deployment-controller	payload-processing-e2e-inf-a-b8f252	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-a-b8f252-65ffcc7559 from 0 to 1
01:38:20	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-b8f252-6475998987	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq
01:38:20	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-a-b8f252	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-a-b8f252-6475998987 from 0 to 1
01:38:20 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-b8f252-6475998987	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-a-b8f252-6475998987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b8f252: serviceaccount "payload-processing-e2e-inf-a-b8f252" not found
01:38:21	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:38:21	openshift-ingress	multus	payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z	AddedInterface	Add eth0 [10.133.0.195/23] from ovn-kubernetes
01:38:21	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq	Started	Container started
01:38:21	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq	Created	Container created
01:38:21	openshift-ingress	kubelet	payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z	Created	Container created
01:38:21	openshift-ingress	multus	payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq	AddedInterface	Add eth0 [10.133.0.194/23] from ovn-kubernetes
01:38:21	openshift-ingress	kubelet	payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:38:21	openshift-ingress	kubelet	payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z	Started	Container started
01:38:21	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-b8f252-65ffcc7559	SuccessfulCreate	Created pod: payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z
01:38:25 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	ProbeError	Startup probe error: Get "http://10.134.1.18:15021/healthz/ready": dial tcp 10.134.1.18:15021: connect: connection refused body:
01:38:25 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Unhealthy	Startup probe failed: Get "http://10.134.1.18:15021/healthz/ready": dial tcp 10.134.1.18:15021: connect: connection refused
01:38:25 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Unhealthy	Startup probe failed: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused
01:38:25 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	ProbeError	Startup probe error: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused body:
01:38:26 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	ProbeError	Startup probe error: Get "http://10.134.1.19:15021/healthz/ready": dial tcp 10.134.1.19:15021: connect: connection refused body:
01:38:26 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Unhealthy	Startup probe failed: Get "http://10.134.1.19:15021/healthz/ready": dial tcp 10.134.1.19:15021: connect: connection refused
01:38:27	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	ProbeError	Startup probe error: Get "http://10.134.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:38:27	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Unhealthy	Startup probe failed: Get "http://10.134.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:38:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	ProbeError	Startup probe error: Get "http://10.134.1.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:38:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Unhealthy	Startup probe failed: Get "http://10.134.1.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:38:39	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	Killing	Stopping container istio-proxy
01:38:40	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:38:40	openshift-ingress	kubelet	e2e-inf-a-a85846-openshift-default-6c946d9dbc-vn9bb	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:38:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-599a52e9 namespace
01:39:06 (x2)	openshift-ingress	kubelet	e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	Started	Container started
01:39:06 (x2)	openshift-ingress	kubelet	e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:39:06 (x2)	openshift-ingress	kubelet	e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	Created	Container created
01:39:11 (x5)	openshift-ingress	kubelet	e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	Unhealthy	Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused
01:39:11 (x5)	openshift-ingress	kubelet	e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	ProbeError	Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused body:
01:39:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-d4c457-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:39:20 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-d4c457-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:39:34	openshift-ingress	kubelet	e2e-inf-a-009c48-openshift-default-77bf58896c-hnsb4	Killing	Stopping container istio-proxy
01:39:35 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-d4c457-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:39:35 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-d4c457-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:39:36	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-unlabeled-fd62200b namespace
01:40:01	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-8741da-5d66f5844c-g7x67	Killing	Stopping container payload-pre-processing
01:40:01	openshift-ingress	kubelet	payload-processing-e2e-inf-a-8741da-78dfdf54c9-d6r9k	Killing	Stopping container payload-processing
01:40:06 (x2)	openshift-ingress	kubelet	e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:40:06 (x2)	openshift-ingress	kubelet	e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	Started	Container started
01:40:06 (x2)	openshift-ingress	kubelet	e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	Created	Container created
01:40:11 (x5)	openshift-ingress	kubelet	e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	Unhealthy	Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
01:40:11 (x5)	openshift-ingress	kubelet	e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	ProbeError	Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
01:40:13 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-b8f252-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:40:13 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-b8f252-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:40:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Unhealthy	Readiness probe failed: Get "http://10.132.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:40:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	ProbeError	Readiness probe error: Get "http://10.132.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:41:07	openshift-ingress	kubelet	e2e-inf-a-8741da-openshift-default-5796f4f49c-ntqbv	Killing	Stopping container istio-proxy
01:41:12	openshift-ingress	replicaset-controller	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865	SuccessfulCreate	Created pod: e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb
01:41:12	openshift-ingress	gateway_labeler_controller	e2e-inf-b-8d8ef5	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8d8ef5
01:41:12	openshift-ingress	deployment-controller	e2e-inf-b-8d8ef5-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865 from 0 to 1
01:41:13	openshift-ingress	multus	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	AddedInterface	Add eth0 [10.134.1.20/23] from ovn-kubernetes
01:41:15	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-d4c457-6465889bc9-wgqgf	Killing	Stopping container payload-pre-processing
01:41:15	openshift-ingress	kubelet	payload-processing-e2e-inf-b-d4c457-54656b5fd9-j8s86	Killing	Stopping container payload-processing
01:41:16	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-b-8d8ef5 namespace
01:41:21	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb
01:41:21	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-b-8d8ef5	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9 from 0 to 1
01:41:21 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8d8ef5: serviceaccount "payload-processing-e2e-inf-b-8d8ef5" not found
01:41:21	openshift-ingress	deployment-controller	payload-processing-e2e-inf-b-8d8ef5	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c from 0 to 1
01:41:21 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c	FailedCreate	Error creating: pods "payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8d8ef5: serviceaccount "payload-processing-e2e-inf-b-8d8ef5" not found
01:41:22	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:41:22	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb	Started	Container started
01:41:22	openshift-ingress	kubelet	payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4	Started	Container started
01:41:22	openshift-ingress	multus	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb	AddedInterface	Add eth0 [10.133.0.197/23] from ovn-kubernetes
01:41:22	openshift-ingress	kubelet	payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4	Created	Container created
01:41:22	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c	SuccessfulCreate	Created pod: payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4
01:41:22	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb	Created	Container created
01:41:22	openshift-ingress	kubelet	payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:41:22	openshift-ingress	multus	payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4	AddedInterface	Add eth0 [10.133.0.198/23] from ovn-kubernetes
01:41:23	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-19ccef75 namespace
01:41:26	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-f124e1ae namespace
01:42:34	openshift-ingress	kubelet	e2e-inf-b-d4c457-openshift-default-56698d568c-8fdkg	Killing	Stopping container istio-proxy
01:42:35	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-webhook-sub-299dd0f2 namespace
01:42:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-webhook-auth-59061aa6 namespace
01:43:11	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-99b1a257 namespace
01:43:12	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-45efa8fc namespace
01:43:16	openshift-ingress	replicaset-controller	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7	SuccessfulCreate	Created pod: e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd
01:43:16	openshift-ingress	deployment-controller	e2e-inf-a-ea26fb-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-ea26fb-openshift-default-74f4ff95d7 from 0 to 1
01:43:16	openshift-ingress	gateway_labeler_controller	e2e-inf-a-ea26fb	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ea26fb
01:43:17	openshift-ingress	multus	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	AddedInterface	Add eth0 [10.133.0.201/23] from ovn-kubernetes
01:43:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-a-ea26fb namespace
01:43:24	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk
01:43:24	openshift-ingress	deployment-controller	payload-processing-e2e-inf-a-ea26fb	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-a-ea26fb-7f56cd94bf from 0 to 1
01:43:24 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-ea26fb-7f56cd94bf	FailedCreate	Error creating: pods "payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ea26fb: serviceaccount "payload-processing-e2e-inf-a-ea26fb" not found
01:43:24	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-a-ea26fb	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5 from 0 to 1
01:43:24 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ea26fb: serviceaccount "payload-processing-e2e-inf-a-ea26fb" not found
01:43:25	openshift-ingress	gateway_labeler_controller	e2e-mt-2ce2764b	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2ce2764b
01:43:25	openshift-ingress	kubelet	payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf	Created	Container created
01:43:25	openshift-ingress	multus	payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk	AddedInterface	Add eth0 [10.134.1.21/23] from ovn-kubernetes
01:43:25	openshift-ingress	replicaset-controller	e2e-mt-2ce2764b-openshift-default-8f8744bd5	SuccessfulCreate	Created pod: e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5
01:43:25	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk	Created	Container created
01:43:25	openshift-ingress	kubelet	payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf	Started	Container started
01:43:25	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:43:25	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-ea26fb-7f56cd94bf	SuccessfulCreate	Created pod: payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf
01:43:25	openshift-ingress	multus	payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf	AddedInterface	Add eth0 [10.133.0.202/23] from ovn-kubernetes
01:43:25	openshift-ingress	kubelet	payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:43:25	openshift-ingress	deployment-controller	e2e-mt-2ce2764b-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-2ce2764b-openshift-default-8f8744bd5 from 0 to 1
01:43:26	openshift-ingress	multus	e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	AddedInterface	Add eth0 [10.134.1.22/23] from ovn-kubernetes
01:43:26	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk	Started	Container started
01:43:29	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-2ce2764b namespace
01:43:32	openshift-ingress	deployment-controller	payload-pre-processing-e2e-mt-2ce2764b	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-mt-2ce2764b-6575578955 from 0 to 1
01:43:32	openshift-ingress	deployment-controller	payload-processing-e2e-mt-2ce2764b	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-mt-2ce2764b-f569676d9 from 0 to 1
01:43:33	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-2ce2764b-f569676d9	SuccessfulCreate	Created pod: payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4
01:43:33	openshift-ingress	multus	payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb	AddedInterface	Add eth0 [10.133.0.203/23] from ovn-kubernetes
01:43:33 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-2ce2764b-f569676d9	FailedCreate	Error creating: pods "payload-processing-e2e-mt-2ce2764b-f569676d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2ce2764b: serviceaccount "payload-processing-e2e-mt-2ce2764b" not found
01:43:33 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-2ce2764b-6575578955	FailedCreate	Error creating: pods "payload-pre-processing-e2e-mt-2ce2764b-6575578955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2ce2764b: serviceaccount "payload-processing-e2e-mt-2ce2764b" not found
01:43:33	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-2ce2764b-6575578955	SuccessfulCreate	Created pod: payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb
01:43:34	openshift-ingress	kubelet	payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:43:34	openshift-ingress	kubelet	payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4	Created	Container created
01:43:34	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:43:34	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb	Created	Container created
01:43:34	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb	Started	Container started
01:43:34	openshift-ingress	multus	payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4	AddedInterface	Add eth0 [10.133.0.204/23] from ovn-kubernetes
01:43:34	openshift-ingress	kubelet	payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4	Started	Container started
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	ProbeError	Readiness probe error: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	ProbeError	Readiness probe error: Get "http://10.134.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	ProbeError	Readiness probe error: Get "http://10.133.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Unhealthy	Readiness probe failed: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	ProbeError	Readiness probe error: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Unhealthy	Readiness probe failed: Get "http://10.134.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	ProbeError	Readiness probe error: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	Unhealthy	Readiness probe failed: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	Unhealthy	Readiness probe failed: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:43:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Unhealthy	Readiness probe failed: Get "http://10.133.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:43:55 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-2ce2764b-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:43:55 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-2ce2764b-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:44:06 (x2)	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	Created	Container created
01:44:06 (x2)	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:44:06 (x2)	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	Started	Container started
01:44:12 (x5)	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	Unhealthy	Startup probe failed: Get "http://10.134.1.20:15021/healthz/ready": dial tcp 10.134.1.20:15021: connect: connection refused
01:44:12 (x5)	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	ProbeError	Startup probe error: Get "http://10.134.1.20:15021/healthz/ready": dial tcp 10.134.1.20:15021: connect: connection refused body:
01:44:13 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-8d8ef5-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:44:13 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-8d8ef5-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:44:44 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-8d8ef5-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:44:44 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-8d8ef5-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:45:13 (x2)	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	Started	Container started
01:45:13 (x2)	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	Created	Container created
01:45:13 (x2)	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:45:17	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-ea26fb-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:45:17	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-ea26fb-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:45:18 (x5)	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	ProbeError	Startup probe error: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused body:
01:45:18 (x5)	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	Unhealthy	Startup probe failed: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused
01:45:47 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-ea26fb-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:45:47 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-ea26fb-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:46:16	openshift-ingress	deployment-controller	e2e-inf-b-b4bf77-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-b4bf77-openshift-default-57fb5d7797 from 0 to 1
01:46:16	openshift-ingress	replicaset-controller	e2e-inf-b-b4bf77-openshift-default-57fb5d7797	SuccessfulCreate	Created pod: e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26
01:46:16	openshift-ingress	gateway_labeler_controller	e2e-inf-b-b4bf77	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b4bf77
01:46:17	openshift-ingress	multus	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	AddedInterface	Add eth0 [10.134.1.32/23] from ovn-kubernetes
01:46:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-b-b4bf77 namespace
01:46:26	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-b-b4bf77	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c from 0 to 1
01:46:26	openshift-ingress	deployment-controller	payload-processing-e2e-inf-b-b4bf77	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-b-b4bf77-5c55f69d87 from 0 to 1
01:46:27	openshift-ingress	multus	payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh	AddedInterface	Add eth0 [10.133.0.216/23] from ovn-kubernetes
01:46:27	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-b4bf77-5c55f69d87	SuccessfulCreate	Created pod: payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv
01:46:27 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-b4bf77-5c55f69d87	FailedCreate	Error creating: pods "payload-processing-e2e-inf-b-b4bf77-5c55f69d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b4bf77: serviceaccount "payload-processing-e2e-inf-b-b4bf77" not found
01:46:27 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b4bf77: serviceaccount "payload-processing-e2e-inf-b-b4bf77" not found
01:46:27	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh
01:46:27	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:46:27	openshift-ingress	multus	payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv	AddedInterface	Add eth0 [10.133.0.217/23] from ovn-kubernetes
01:46:27	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh	Created	Container created
01:46:28	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh	Started	Container started
01:46:28	openshift-ingress	kubelet	payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv	Started	Container started
01:46:28	openshift-ingress	kubelet	payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv	Created	Container created
01:46:28	openshift-ingress	kubelet	payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:46:38	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-2ce2764b-6575578955-jhdrb	Killing	Stopping container payload-pre-processing
01:46:38	openshift-ingress	kubelet	payload-processing-e2e-mt-2ce2764b-f569676d9-rd9m4	Killing	Stopping container payload-processing
01:46:38	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w0-28b1d4	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-28b1d4
01:46:38 (x2)	openshift-ingress	kubelet	e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	Started	Container started
01:46:38 (x2)	openshift-ingress	kubelet	e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:46:38 (x2)	openshift-ingress	kubelet	e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	Created	Container created
01:46:39	openshift-ingress	deployment-controller	e2e-shared-a-w0-28b1d4-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w0-28b1d4-openshift-default-79f795b757 from 0 to 1
01:46:39	openshift-ingress	replicaset-controller	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757	SuccessfulCreate	Created pod: e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh
01:46:39	openshift-ingress	multus	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	AddedInterface	Add eth0 [10.133.0.218/23] from ovn-kubernetes
01:46:43	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-a-w0-28b1d4 namespace
01:46:44 (x6)	openshift-ingress	kubelet	e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	ProbeError	Startup probe error: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused body:
01:46:44 (x6)	openshift-ingress	kubelet	e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	Unhealthy	Startup probe failed: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused
01:46:46	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w0-28b1d4	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w0-28b1d4-5966d64695 from 0 to 1
01:46:47	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts	AddedInterface	Add eth0 [10.134.1.34/23] from ovn-kubernetes
01:46:47	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w0-28b1d4-5966d64695	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l
01:46:47 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-28b1d4: serviceaccount "payload-processing-e2e-shared-a-w0-28b1d4" not found
01:46:47	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts
01:46:47	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w0-28b1d4	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967 from 0 to 1
01:46:47 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w0-28b1d4-5966d64695	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-28b1d4: serviceaccount "payload-processing-e2e-shared-a-w0-28b1d4" not found
01:46:48	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts	Started	Container started
01:46:48	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l	Started	Container started
01:46:48	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts	Created	Container created
01:46:48	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:46:48	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l	Created	Container created
01:46:48	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:46:48	openshift-ingress	multus	payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l	AddedInterface	Add eth0 [10.133.0.219/23] from ovn-kubernetes
01:46:57 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-2ce2764b-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:46:57 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-mt-2ce2764b-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:48:02	openshift-ingress	kubelet	e2e-mt-2ce2764b-openshift-default-8f8744bd5-x6jv5	Killing	Stopping container istio-proxy
01:48:19 (x2)	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	Started	Container started
01:48:19 (x2)	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:48:19	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	ProbeError	Readiness probe error: Get "http://10.134.1.32:15021/healthz/ready": dial tcp 10.134.1.32:15021: connect: connection refused body:
01:48:19	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	Unhealthy	Readiness probe failed: Get "http://10.134.1.32:15021/healthz/ready": dial tcp 10.134.1.32:15021: connect: connection refused
01:48:19 (x2)	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	Created	Container created
01:48:25 (x5)	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	ProbeError	Startup probe error: Get "http://10.134.1.32:15021/healthz/ready": dial tcp 10.134.1.32:15021: connect: connection refused body:
01:48:25 (x5)	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	Unhealthy	Startup probe failed: Get "http://10.134.1.32:15021/healthz/ready": dial tcp 10.134.1.32:15021: connect: connection refused
01:48:32 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-b4bf77-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:48:32 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-b4bf77-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:48:47 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-b4bf77-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:48:47 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-b-b4bf77-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:48:56 (x2)	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:48:56 (x2)	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	Created	Container created
01:48:56 (x2)	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	Started	Container started
01:49:02 (x5)	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	Unhealthy	Startup probe failed: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused
01:49:02 (x5)	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	ProbeError	Startup probe error: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused body:
01:49:20	openshift-ingress	deployment-controller	e2e-shared-a-w3-362c56-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff from 1 to 2
01:49:20	openshift-ingress	replicaset-controller	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff	SuccessfulCreate	Created pod: e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp
01:49:20	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w3-362c56-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:49:21	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	Started	Container started
01:49:21	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	Created	Container created
01:49:21	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:49:21	openshift-ingress	multus	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	AddedInterface	Add eth0 [10.133.0.221/23] from ovn-kubernetes
01:49:25 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w0-28b1d4-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:49:25 (x4)	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-a-w0-28b1d4-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:49:26 (x5)	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	Unhealthy	Startup probe failed: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused
01:49:26 (x5)	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	ProbeError	Startup probe error: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused body:
01:49:33	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-ea26fb-8d4f5cdc5-cdxdk	Killing	Stopping container payload-pre-processing
01:49:33	openshift-ingress	kubelet	payload-processing-e2e-inf-a-ea26fb-7f56cd94bf-md6sf	Killing	Stopping container payload-processing
01:49:50	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w0-28b1d4-7d6f6967-q5rts	Killing	Stopping container payload-pre-processing
01:49:50	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w0-28b1d4-5966d64695-vfd4l	Killing	Stopping container payload-processing
01:50:25	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq	Killing	Stopping container payload-pre-processing
01:50:25	openshift-ingress	kubelet	payload-processing-e2e-inf-a-b8f252-65ffcc7559-gs66z	Killing	Stopping container payload-processing
01:50:43 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-b8f252-6475998987-bmzdq	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:50:49	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	Killing	Stopping container istio-proxy
01:50:50	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:50:50	openshift-ingress	kubelet	e2e-inf-a-ea26fb-openshift-default-74f4ff95d7-jr4wd	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:50:57	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-b4bf77-549586fc8c-ntrjh	Killing	Stopping container payload-pre-processing
01:50:57	openshift-ingress	kubelet	payload-processing-e2e-inf-b-b4bf77-5c55f69d87-rrdvv	Killing	Stopping container payload-processing
01:51:08	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-pl9jb
01:51:08	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-td7wh	Killing	Stopping container istio-proxy
01:51:08	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Killing	Stopping container istio-proxy
01:51:08	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Killing	Stopping container istio-proxy
01:51:08	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-jfkxg
01:51:08	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-8qhvg
01:51:08	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-td7wh
01:51:08	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-44k5r
01:51:08	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-dqmwg
01:51:08	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Killing	Stopping container istio-proxy
01:51:08	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Killing	Stopping container istio-proxy
01:51:08 (x2)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 4; reason: All metrics below target
01:51:08	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Killing	Stopping container istio-proxy
01:51:08	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-848f6bf8bc from 10 to 4
01:51:10	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:51:10	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:51:10	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-pl9jb	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:51:10	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-dqmwg	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:51:12	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:51:12	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jfkxg	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:51:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:51:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8qhvg	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:51:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	ProbeError	Readiness probe error: Get "http://10.134.1.19:15021/healthz/ready": dial tcp 10.134.1.19:15021: connect: connection refused body:
01:51:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-44k5r	Unhealthy	Readiness probe failed: Get "http://10.134.1.19:15021/healthz/ready": dial tcp 10.134.1.19:15021: connect: connection refused
01:51:14	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	Killing	Stopping container istio-proxy
01:51:17	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-b8f252-openshift-default	FailedUpdateStatus	horizontalpodautoscalers.autoscaling "e2e-inf-a-b8f252-openshift-default" not found
01:51:17	openshift-ingress	kubelet	e2e-inf-a-b8f252-openshift-default-54b89bd66f-mpgzp	Killing	Stopping container istio-proxy
01:51:17 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-b8f252-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:51:17 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-inf-a-b8f252-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:51:18	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:51:18	openshift-ingress	kubelet	e2e-shared-a-w0-28b1d4-openshift-default-79f795b757-xmwwh	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:51:24	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb	Killing	Stopping container payload-pre-processing
01:51:24	openshift-ingress	kubelet	payload-processing-e2e-inf-b-8d8ef5-64c9cc5c8c-89fz4	Killing	Stopping container payload-processing
01:51:29	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-902076-664f4c595-qstk6	Killing	Stopping container payload-processing
01:51:29	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	Killing	Stopping container payload-pre-processing
01:51:44 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-8d8ef5-977d97c9-5kpxb	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:51:44 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:51:45 (x2)	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-902076-664f4c595-qstk6	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:51:55	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-902076-84f6ccb8d7-6fp2p	Unhealthy	Readiness probe failed: timeout: failed to connect service "10.134.0.53:50052" within 1s: context deadline exceeded
01:52:14	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd	Killing	Stopping container payload-pre-processing
01:52:14	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg	Killing	Stopping container payload-processing
01:52:18	openshift-ingress	kubelet	e2e-inf-b-b4bf77-openshift-default-57fb5d7797-cdn26	Killing	Stopping container istio-proxy
01:52:20	openshift-ingress	kubelet	e2e-worker-w0-902076-openshift-default-d75675f49-qmxmx	Killing	Stopping container istio-proxy
01:52:38 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w1-22e246-68d958957f-q2lfd	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:52:38 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w1-22e246-545bdbdbf-xs8rg	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:52:38	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	Killing	Stopping container istio-proxy
01:52:43	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:52:43	openshift-ingress	kubelet	e2e-inf-b-8d8ef5-openshift-default-5ddcfb4865-fpbhb	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:52:45	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2	Killing	Stopping container payload-pre-processing
01:52:45	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt	Killing	Stopping container payload-processing
01:53:06 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w4-27fc07-759d888567-8ffnt	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:53:06 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w4-27fc07-76dc845699-xmhf2	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:53:10	opendatahub	kubelet	test-curl-7466-9d7516	Created	Container created
01:53:10	opendatahub	multus	test-curl-7466-9d7516	AddedInterface	Add eth0 [10.133.0.227/23] from ovn-kubernetes
01:53:10	opendatahub	kubelet	test-curl-7466-9d7516	Started	Container started
01:53:10	opendatahub	kubelet	test-curl-7466-9d7516	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:53:13	opendatahub	kubelet	test-curl-7466-97d23a	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
01:53:13	opendatahub	kubelet	test-curl-7466-97d23a	Started	Container started
01:53:13	opendatahub	kubelet	test-curl-7466-9d7516	Killing	Stopping container test-curl-7466-9d7516
01:53:13	opendatahub	kubelet	test-curl-7466-97d23a	Created	Container created
01:53:13	openshift-ingress	kubelet	e2e-shared-a-w1-22e246-openshift-default-58d9ff9759-t5rhn	Killing	Stopping container istio-proxy
01:53:13	opendatahub	multus	test-curl-7466-97d23a	AddedInterface	Add eth0 [10.133.0.228/23] from ovn-kubernetes
01:53:16	opendatahub	kubelet	test-curl-7466-97d23a	Killing	Stopping container test-curl-7466-97d23a
01:53:22	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs	Killing	Stopping container payload-pre-processing
01:53:22	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z	Killing	Stopping container payload-processing
01:53:28	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	Killing	Stopping container istio-proxy
01:53:30	openshift-ingress	deployment-controller	e2e-shared-b-w3-8e2d45-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w3-8e2d45-openshift-default-555c556899 from 1 to 2
01:53:30	openshift-ingress	horizontal-pod-autoscaler	e2e-shared-b-w3-8e2d45-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:53:30	openshift-ingress	replicaset-controller	e2e-shared-b-w3-8e2d45-openshift-default-555c556899	SuccessfulCreate	Created pod: e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n
01:53:31	openshift-ingress	multus	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	AddedInterface	Add eth0 [10.133.0.231/23] from ovn-kubernetes
01:53:31	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	Created	Container created
01:53:31	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	Started	Container started
01:53:31	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:53:34	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	Unhealthy	Readiness probe failed: Get "http://10.132.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:53:34	openshift-ingress	kubelet	e2e-shared-a-w4-27fc07-openshift-default-7d4f8fffdf-tlt8m	ProbeError	Readiness probe error: Get "http://10.132.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:53:36	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv	Killing	Stopping container payload-processing
01:53:36	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7	Killing	Stopping container payload-pre-processing
01:53:38 (x6)	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	ProbeError	Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
01:53:38 (x6)	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	Unhealthy	Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
01:53:39 (x2)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 3; reason: All metrics below target
01:53:39	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Killing	Stopping container istio-proxy
01:53:39 (x2)	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-848f6bf8bc from 4 to 3
01:53:39	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-p79k2
01:53:40	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:53:40 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w1-cd9116-5f9dc49965-jfr9z	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:53:40	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-p79k2	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:53:40 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w1-cd9116-5f7cd794c5-vd6fs	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:53:54 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w4-faec96-77496bd575-6jrt7	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:53:54 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w4-faec96-56df9cd747-5vpfv	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:53:59	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:53:59	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:53:59	openshift-ingress	kubelet	e2e-shared-b-w4-faec96-openshift-default-5869cf6989-hwg65	Killing	Stopping container istio-proxy
01:54:13	openshift-ingress	kubelet	e2e-shared-b-w1-cd9116-openshift-default-645bd4f4d7-t5qmk	Killing	Stopping container istio-proxy
01:54:16	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-e5b28f-56d47dff95-mg5rh	Killing	Stopping container payload-pre-processing
01:54:16	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-e5b28f-7d79c46b5f-jq762	Killing	Stopping container payload-processing
01:54:32	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg	Killing	Stopping container payload-pre-processing
01:54:32	openshift-ingress	kubelet	payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96	Killing	Stopping container payload-processing
01:54:52 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w1-552952-7bcb88f69f-9pvlg	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:54:52 (x2)	openshift-ingress	kubelet	payload-processing-e2e-worker-w1-552952-56b96b5f5c-2vd96	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:54:53 (x3)	openshift-ingress	deployment-controller	e2e-worker-w4-e5b28f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-e5b28f-openshift-default-6df948d69 from 1 to 2
01:54:53	openshift-ingress	replicaset-controller	e2e-worker-w4-e5b28f-openshift-default-6df948d69	SuccessfulCreate	Created pod: e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r
01:54:53 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w4-e5b28f-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:54:53	openshift-ingress	multus	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	AddedInterface	Add eth0 [10.134.1.38/23] from ovn-kubernetes
01:54:53	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:54:54	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	Created	Container created
01:54:54	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	Started	Container started
01:54:55	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	Killing	Stopping container istio-proxy
01:54:56	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	FailedToRetrieveImagePullSecret	Unable to retrieve some image pull secrets (e2e-worker-w4-e5b28f-openshift-default-dockercfg-kg5gs); attempting to pull the image may not succeed.
01:54:57 (x3)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	Unhealthy	Startup probe failed: Get "http://10.134.1.38:15021/healthz/ready": dial tcp 10.134.1.38:15021: connect: connection refused
01:54:57 (x3)	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	ProbeError	Startup probe error: Get "http://10.134.1.38:15021/healthz/ready": dial tcp 10.134.1.38:15021: connect: connection refused body:
01:54:57	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-rsq9r	Killing	Stopping container istio-proxy
01:55:00	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:55:00 (x2)	openshift-ingress	deployment-controller	e2e-worker-w1-552952-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w1-552952-openshift-default-855478bdc from 1 to 2
01:55:00	openshift-ingress	replicaset-controller	e2e-worker-w1-552952-openshift-default-855478bdc	SuccessfulCreate	Created pod: e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d
01:55:00 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w1-552952-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:55:00	openshift-ingress	kubelet	e2e-worker-w4-e5b28f-openshift-default-6df948d69-225bn	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:55:01	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	Started	Container started
01:55:01	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	Created	Container created
01:55:01	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:55:01	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-7blqg	Killing	Stopping container istio-proxy
01:55:01	openshift-ingress	multus	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	AddedInterface	Add eth0 [10.133.0.237/23] from ovn-kubernetes
01:55:02	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	Unhealthy	Startup probe failed: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused
01:55:02	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	ProbeError	Startup probe error: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused body:
01:55:02	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	FailedToRetrieveImagePullSecret	Unable to retrieve some image pull secrets (e2e-worker-w1-552952-openshift-default-dockercfg-kpd6x); attempting to pull the image may not succeed.
01:55:03	openshift-ingress	kubelet	e2e-worker-w1-552952-openshift-default-855478bdc-vjh7d	Killing	Stopping container istio-proxy
01:55:18	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh	Killing	Stopping container payload-pre-processing
01:55:18	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j	Killing	Stopping container payload-processing
01:55:26	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-kcb9p	Killing	Stopping container istio-proxy
01:55:26	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	Killing	Stopping container istio-proxy
01:55:27	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:55:27	openshift-ingress	kubelet	e2e-shared-a-w3-362c56-openshift-default-5bf64f57ff-mskrp	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:55:34	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx	Killing	Stopping container payload-processing
01:55:34	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6	Killing	Stopping container payload-pre-processing
01:55:37 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-362c56-94b8b4c79-lv5mh	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:55:37 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-362c56-5df76ccf9c-gjd9j	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:55:55 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-8e2d45-d4d9bc679-wxgl6	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:55:55 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-8e2d45-fb4548545-bxpkx	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:56:05	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-rk2xk	Killing	Stopping container istio-proxy
01:56:05	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	Killing	Stopping container istio-proxy
01:56:09	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:56:09	openshift-ingress	kubelet	e2e-shared-b-w3-8e2d45-openshift-default-555c556899-g2x5n	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:56:10	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-6cf6c	Killing	Stopping container istio-proxy
01:56:10	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-6cf6c
01:56:10 (x2)	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-848f6bf8bc from 3 to 2
01:56:10 (x2)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 2; reason: All metrics below target
01:56:20	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf	Killing	Stopping container payload-pre-processing
01:56:20	openshift-ingress	kubelet	payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8	Killing	Stopping container payload-processing
01:56:39	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	Created	Container created
01:56:39	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	Started	Container started
01:56:39	openshift-ingress	replicaset-controller	e2e-worker-w3-e16993-openshift-default-778bff8645	SuccessfulCreate	Created pod: e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4
01:56:39	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:56:39 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w3-e16993-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:56:39	openshift-ingress	multus	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	AddedInterface	Add eth0 [10.134.1.42/23] from ovn-kubernetes
01:56:39 (x3)	openshift-ingress	deployment-controller	e2e-worker-w3-e16993-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w3-e16993-openshift-default-778bff8645 from 1 to 2
01:56:43 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w3-e16993-6f96699995-cwgsf	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:56:43 (x2)	openshift-ingress	kubelet	payload-processing-e2e-worker-w3-e16993-cb676db4c-xdjw8	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:56:46 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	Unhealthy	Startup probe failed: Get "http://10.134.1.42:15021/healthz/ready": dial tcp 10.134.1.42:15021: connect: connection refused
01:56:46 (x7)	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	ProbeError	Startup probe error: Get "http://10.134.1.42:15021/healthz/ready": dial tcp 10.134.1.42:15021: connect: connection refused body:
01:56:58	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	Killing	Stopping container istio-proxy
01:56:58	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-t2bhb	Killing	Stopping container istio-proxy
01:57:02	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:57:02	openshift-ingress	kubelet	e2e-worker-w3-e16993-openshift-default-778bff8645-zrdc4	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:58:08	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p	Killing	Stopping container payload-processing
01:58:08	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt	Killing	Stopping container payload-pre-processing
01:58:21	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	Killing	Stopping container istio-proxy
01:58:26	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:58:26	openshift-ingress	kubelet	e2e-shared-a-w2-4ed7e0-openshift-default-6498cdddd5-tnnst	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:58:29	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26	Killing	Stopping container payload-processing
01:58:29	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c	Killing	Stopping container payload-pre-processing
01:58:33 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-4ed7e0-8667f8955f-2wx8p	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:58:33 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-4ed7e0-589cf4dbb7-s7lgt	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:58:41	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-848f6bf8bc-7lvhw
01:58:41	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-7lvhw	Killing	Stopping container istio-proxy
01:58:41 (x2)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 1; reason: All metrics below target
01:58:41 (x2)	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-848f6bf8bc from 2 to 1
01:58:43	openshift-ingress	kubelet	e2e-shared-b-w2-5fedc7-openshift-default-74b6f7ccd9-zxwmj	Killing	Stopping container istio-proxy
01:58:52 (x2)	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-5fedc7-6d76869dd7-nht26	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:58:52 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-5fedc7-7cf77b4bc-sk84c	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:58:56	openshift-ingress	kubelet	payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8	Killing	Stopping container payload-processing
01:58:57	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz	Killing	Stopping container payload-pre-processing
01:59:10	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
01:59:10	openshift-ingress	multus	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	AddedInterface	Add eth0 [10.134.1.48/23] from ovn-kubernetes
01:59:10	openshift-ingress	replicaset-controller	e2e-worker-w2-ee1538-openshift-default-75449464f5	SuccessfulCreate	Created pod: e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln
01:59:10 (x2)	openshift-ingress	deployment-controller	e2e-worker-w2-ee1538-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w2-ee1538-openshift-default-75449464f5 from 1 to 2
01:59:10 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-w2-ee1538-openshift-default	SuccessfulRescale	New size: 2; reason: cpu resource utilization (percentage of request) above target
01:59:11	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	Created	Container created
01:59:11	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	Started	Container started
01:59:15 (x2)	openshift-ingress	kubelet	payload-processing-e2e-worker-w2-ee1538-759dbdcf97-zj4b8	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:59:15 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w2-ee1538-dbd8fbc99-r4npz	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
01:59:17 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	Unhealthy	Startup probe failed: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused
01:59:17 (x6)	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	ProbeError	Startup probe error: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused body:
01:59:31	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-9sqqx	Killing	Stopping container istio-proxy
01:59:31	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	Killing	Stopping container istio-proxy
01:59:34	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:59:34	openshift-ingress	kubelet	e2e-worker-w2-ee1538-openshift-default-75449464f5-j2bln	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:59:44	openshift-ingress	replicaset-controller	e2e-ait-c4a6ee17-openshift-default-58df75f7f7	SuccessfulCreate	Created pod: e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9
01:59:44	openshift-ingress	deployment-controller	e2e-ait-c4a6ee17-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-c4a6ee17-openshift-default-58df75f7f7 from 0 to 1
01:59:44	openshift-ingress	gateway_labeler_controller	e2e-ait-c4a6ee17	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c4a6ee17
01:59:45	openshift-ingress	multus	e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	AddedInterface	Add eth0 [10.134.1.49/23] from ovn-kubernetes
01:59:48	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ait-c4a6ee17 namespace
01:59:51 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-c4a6ee17-65b649b599	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c4a6ee17: serviceaccount "payload-processing-e2e-ait-c4a6ee17" not found
01:59:51	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-c4a6ee17	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-c4a6ee17-65b649b599 from 0 to 1
01:59:51 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-c4a6ee17-7bc489dc4c	FailedCreate	Error creating: pods "payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c4a6ee17: serviceaccount "payload-processing-e2e-ait-c4a6ee17" not found
01:59:51	openshift-ingress	deployment-controller	payload-processing-e2e-ait-c4a6ee17	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-c4a6ee17-7bc489dc4c from 0 to 1
01:59:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq	Started	Container started
01:59:52	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-c4a6ee17-65b649b599	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq
01:59:52	openshift-ingress	multus	payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj	AddedInterface	Add eth0 [10.134.1.51/23] from ovn-kubernetes
01:59:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:59:52	openshift-ingress	multus	payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq	AddedInterface	Add eth0 [10.134.1.50/23] from ovn-kubernetes
01:59:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq	Created	Container created
01:59:52	openshift-ingress	kubelet	payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
01:59:52	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-c4a6ee17-7bc489dc4c	SuccessfulCreate	Created pod: payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj
01:59:52	openshift-ingress	kubelet	payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj	Created	Container created
01:59:52	openshift-ingress	kubelet	payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj	Started	Container started
02:00:12 (x2)	openshift-ingress	kubelet	e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:00:12 (x2)	openshift-ingress	kubelet	e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	Created	Container created
02:00:12 (x2)	openshift-ingress	kubelet	e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	Started	Container started
02:00:14	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-c4a6ee17-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
02:00:14	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-c4a6ee17-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
02:00:17 (x5)	openshift-ingress	kubelet	e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	Unhealthy	Startup probe failed: Get "http://10.134.1.49:15021/healthz/ready": dial tcp 10.134.1.49:15021: connect: connection refused
02:00:17 (x5)	openshift-ingress	kubelet	e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	ProbeError	Startup probe error: Get "http://10.134.1.49:15021/healthz/ready": dial tcp 10.134.1.49:15021: connect: connection refused body:
02:00:36	openshift-ingress	kubelet	payload-processing-e2e-ait-c4a6ee17-7bc489dc4c-6lfkj	Killing	Stopping container payload-processing
02:00:36	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-c4a6ee17-65b649b599-d8vcq	Killing	Stopping container payload-pre-processing
02:00:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-c4a6ee17-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
02:00:45 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-ait-c4a6ee17-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
02:00:51	openshift-ingress	kubelet	e2e-ait-c4a6ee17-openshift-default-58df75f7f7-svtc9	Killing	Stopping container istio-proxy
02:00:55	opendatahub	replicaset-controller	maas-controller-c6c5b9684	SuccessfulDelete	Deleted pod: maas-controller-c6c5b9684-jdd2p
02:00:55	opendatahub	kubelet	maas-controller-c6c5b9684-jdd2p	Killing	Stopping container manager
02:00:57	opendatahub	replicaset-controller	maas-controller-c6c5b9684	SuccessfulCreate	Created pod: maas-controller-c6c5b9684-j6gz2
02:00:58	opendatahub	multus	maas-controller-c6c5b9684-j6gz2	AddedInterface	Add eth0 [10.132.0.203/23] from ovn-kubernetes
02:00:58	opendatahub	kubelet	maas-controller-c6c5b9684-j6gz2	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd"
02:01:01	opendatahub	kubelet	maas-controller-c6c5b9684-j6gz2	Started	Container started
02:01:01	opendatahub	kubelet	maas-controller-c6c5b9684-j6gz2	Created	Container created
02:01:01	opendatahub	kubelet	maas-controller-c6c5b9684-j6gz2	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd" in 3.367s (3.367s including waiting). Image size: 200069654 bytes.
02:01:19	opendatahub	maas-controller-c6c5b9684-j6gz2_ed5a1105-577e-47c0-a9a0-ea196591f5e2	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-c6c5b9684-j6gz2_ed5a1105-577e-47c0-a9a0-ea196591f5e2 became leader
02:01:28	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	AddedInterface	Add eth0 [10.134.1.55/23] from ovn-kubernetes
02:01:28	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 1 to 4
02:01:28	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-jll62	AddedInterface	Add eth0 [10.134.1.54/23] from ovn-kubernetes
02:01:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-2s8jj
02:01:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-cldnc
02:01:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-jll62
02:01:28	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	AddedInterface	Add eth0 [10.132.0.205/23] from ovn-kubernetes
02:01:28 (x2)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	Started	Container started
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	Created	Container created
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	Created	Container created
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jll62	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jll62	Started	Container started
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	Started	Container started
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:01:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jll62	Created	Container created
02:01:33	opendatahub	kubelet	maas-controller-c6c5b9684-j6gz2	Killing	Stopping container manager
02:01:33 (x2)	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled down replica set maas-controller-c6c5b9684 from 1 to 0
02:01:33	opendatahub	replicaset-controller	maas-controller-c6c5b9684	SuccessfulDelete	Deleted pod: maas-controller-c6c5b9684-j6gz2
02:01:35 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	ProbeError	Startup probe error: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused body:
02:01:35 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	Unhealthy	Startup probe failed: Get "http://10.134.1.55:15021/healthz/ready": dial tcp 10.134.1.55:15021: connect: connection refused
02:01:35 (x3)	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled up replica set maas-controller-c6c5b9684 from 0 to 1
02:01:35	opendatahub	replicaset-controller	maas-controller-c6c5b9684	SuccessfulCreate	Created pod: maas-controller-c6c5b9684-7w7mh
02:01:35 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	Unhealthy	Startup probe failed: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused
02:01:35 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	ProbeError	Startup probe error: Get "http://10.134.1.55:15021/healthz/ready": dial tcp 10.134.1.55:15021: connect: connection refused body:
02:01:36 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jll62	ProbeError	Startup probe error: Get "http://10.134.1.54:15021/healthz/ready": dial tcp 10.134.1.54:15021: connect: connection refused body:
02:01:36 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jll62	Unhealthy	Startup probe failed: Get "http://10.134.1.54:15021/healthz/ready": dial tcp 10.134.1.54:15021: connect: connection refused
02:01:36	opendatahub	multus	maas-controller-c6c5b9684-7w7mh	AddedInterface	Add eth0 [10.132.0.206/23] from ovn-kubernetes
02:01:36	opendatahub	kubelet	maas-controller-c6c5b9684-7w7mh	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd"
02:01:37	opendatahub	kubelet	maas-controller-c6c5b9684-7w7mh	Created	Container created
02:01:37	opendatahub	kubelet	maas-controller-c6c5b9684-7w7mh	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:45f77c950c260ee8efb403c855f8491cf8e4d9f8aad8f0a1557003a1a2a0bfdd" in 886ms (886ms including waiting). Image size: 200069654 bytes.
02:01:37	opendatahub	kubelet	maas-controller-c6c5b9684-7w7mh	Started	Container started
02:01:56	opendatahub	maas-controller-c6c5b9684-7w7mh_6e3d14c7-ea5b-4cfb-99ae-8b49a1cdb952	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-c6c5b9684-7w7mh_6e3d14c7-ea5b-4cfb-99ae-8b49a1cdb952 became leader
02:02:28	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 4 to 8
02:02:28	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 8; reason: cpu resource utilization (percentage of request) above target
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	Started	Container started
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	Created	Container created
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	Created	Container created
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	Started	Container started
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:02:29	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	AddedInterface	Add eth0 [10.133.0.238/23] from ovn-kubernetes
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	Created	Container created
02:02:29	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	AddedInterface	Add eth0 [10.132.0.209/23] from ovn-kubernetes
02:02:29	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	AddedInterface	Add eth0 [10.132.0.208/23] from ovn-kubernetes
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	Created	Container created
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	Started	Container started
02:02:29	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	Started	Container started
02:02:29	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	AddedInterface	Add eth0 [10.134.1.56/23] from ovn-kubernetes
02:02:36 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	ProbeError	Startup probe error: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused body:
02:02:36 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	Unhealthy	Startup probe failed: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused
02:02:36 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	ProbeError	Startup probe error: Get "http://10.134.1.56:15021/healthz/ready": dial tcp 10.134.1.56:15021: connect: connection refused body:
02:02:36 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	Unhealthy	Startup probe failed: Get "http://10.134.1.56:15021/healthz/ready": dial tcp 10.134.1.56:15021: connect: connection refused
02:02:37 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	ProbeError	Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:
02:02:37 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	Unhealthy	Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused
02:02:37 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	Unhealthy	Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused
02:02:37 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	ProbeError	Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused body:
02:02:39 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	ProbeError	Startup probe error: Get "http://10.133.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:02:39 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	Unhealthy	Startup probe failed: Get "http://10.133.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:02:40 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	Unhealthy	Startup probe failed: Get "http://10.134.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:02:40 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	ProbeError	Startup probe error: Get "http://10.134.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:02:40 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	ProbeError	Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:02:40 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	Unhealthy	Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:02:41 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	Unhealthy	Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:02:41 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	ProbeError	Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:02:43 (x3)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 10; reason: cpu resource utilization (percentage of request) above target
02:02:43	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-848f6bf8bc from 8 to 10
02:02:44	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	Started	Container started
02:02:44	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	AddedInterface	Add eth0 [10.134.1.57/23] from ovn-kubernetes
02:02:44	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	Created	Container created
02:02:44	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	Started	Container started
02:02:44	openshift-ingress	multus	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	AddedInterface	Add eth0 [10.133.0.239/23] from ovn-kubernetes
02:02:44	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	Created	Container created
02:02:44	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:02:44	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:02:52 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	Unhealthy	Startup probe failed: Get "http://10.134.1.57:15021/healthz/ready": dial tcp 10.134.1.57:15021: connect: connection refused
02:02:52 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	Unhealthy	Startup probe failed: Get "http://10.133.0.239:15021/healthz/ready": dial tcp 10.133.0.239:15021: connect: connection refused
02:02:52 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	ProbeError	Startup probe error: Get "http://10.134.1.57:15021/healthz/ready": dial tcp 10.134.1.57:15021: connect: connection refused body:
02:02:52 (x8)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	ProbeError	Startup probe error: Get "http://10.133.0.239:15021/healthz/ready": dial tcp 10.133.0.239:15021: connect: connection refused body:
02:02:54	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	Unhealthy	Startup probe failed: Get "http://10.133.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:02:54	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	ProbeError	Startup probe error: Get "http://10.133.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:02:54	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	ProbeError	Startup probe error: Get "http://10.134.1.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:02:54	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	Unhealthy	Startup probe failed: Get "http://10.134.1.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:05:01	openshift-ingress	deployment-controller	e2e-worker-single-main-1009fd-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-single-main-1009fd-openshift-default-6f4d98b65c from 0 to 1
02:05:01	openshift-ingress	gateway_labeler_controller	e2e-worker-single-main-1009fd	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-1009fd
02:05:01	openshift-ingress	replicaset-controller	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65c	SuccessfulCreate	Created pod: e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s
02:05:02	openshift-ingress	multus	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	AddedInterface	Add eth0 [10.134.1.60/23] from ovn-kubernetes
02:05:06	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-single-main-1009fd namespace
02:05:09	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-single-main-1009fd-d98696959	SuccessfulCreate	Created pod: payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd
02:05:09 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-single-main-1009fd-6c659957bc	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-single-main-1009fd-6c659957bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-1009fd: serviceaccount "payload-processing-e2e-worker-single-main-1009fd" not found
02:05:09 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-single-main-1009fd-d98696959	FailedCreate	Error creating: pods "payload-processing-e2e-worker-single-main-1009fd-d98696959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-1009fd: serviceaccount "payload-processing-e2e-worker-single-main-1009fd" not found
02:05:09	openshift-ingress	deployment-controller	payload-processing-e2e-worker-single-main-1009fd	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-single-main-1009fd-d98696959 from 0 to 1
02:05:09	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-single-main-1009fd	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-single-main-1009fd-6c659957bc from 0 to 1
02:05:09	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-single-main-1009fd-6c659957bc	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5
02:05:10	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5	Created	Container created
02:05:10	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:05:10	openshift-ingress	multus	payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd	AddedInterface	Add eth0 [10.134.1.62/23] from ovn-kubernetes
02:05:10	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5	Started	Container started
02:05:10	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd	Created	Container created
02:05:10	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:05:10	openshift-ingress	multus	payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5	AddedInterface	Add eth0 [10.134.1.61/23] from ovn-kubernetes
02:05:10	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd	Started	Container started
02:05:30 (x2)	openshift-ingress	kubelet	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	Created	Container created
02:05:30 (x2)	openshift-ingress	kubelet	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	Started	Container started
02:05:30 (x2)	openshift-ingress	kubelet	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:05:31	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-single-main-1009fd namespace
02:05:36 (x6)	openshift-ingress	kubelet	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	ProbeError	Startup probe error: Get "http://10.134.1.60:15021/healthz/ready": dial tcp 10.134.1.60:15021: connect: connection refused body:
02:05:36 (x6)	openshift-ingress	kubelet	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	Unhealthy	Startup probe failed: Get "http://10.134.1.60:15021/healthz/ready": dial tcp 10.134.1.60:15021: connect: connection refused
02:05:47 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-1009fd-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
02:05:47 (x3)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-1009fd-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
02:06:02	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-1009fd-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
02:06:02	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-1009fd-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
02:06:36	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5	Killing	Stopping container payload-pre-processing
02:06:36	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd	Killing	Stopping container payload-processing
02:06:52 (x2)	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-1009fd-d986969599k4zd	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
02:06:52 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-1009fd-6c65968hf5	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
02:07:15	openshift-ingress	kubelet	e2e-worker-single-main-1009fd-openshift-default-6f4d98b65ckgj4s	Killing	Stopping container istio-proxy
02:09:55	openshift-ingress	replicaset-controller	payload-pre-processing-78b8657c54	SuccessfulCreate	Created pod: payload-pre-processing-78b8657c54-mttsl
02:09:55	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-78b8657c54 from 0 to 1
02:09:56	openshift-ingress	kubelet	payload-pre-processing-78b8657c54-mttsl	Started	Container started
02:09:56	openshift-ingress	multus	payload-pre-processing-78b8657c54-mttsl	AddedInterface	Add eth0 [10.132.0.222/23] from ovn-kubernetes
02:09:56	openshift-ingress	kubelet	payload-pre-processing-78b8657c54-mttsl	Created	Container created
02:09:56	openshift-ingress	kubelet	payload-pre-processing-78b8657c54-mttsl	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:10:08	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-pgcrl	Killing	Stopping container payload-pre-processing
02:10:08	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0
02:10:08	openshift-ingress	replicaset-controller	payload-pre-processing-7b98bb678c	SuccessfulDelete	Deleted pod: payload-pre-processing-7b98bb678c-pgcrl
02:10:10	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-6cdffb9d78 from 0 to 1
02:10:10	openshift-ingress	multus	payload-processing-6cdffb9d78-6qjf8	AddedInterface	Add eth0 [10.134.1.64/23] from ovn-kubernetes
02:10:10	openshift-ingress	replicaset-controller	payload-processing-6cdffb9d78	SuccessfulCreate	Created pod: payload-processing-6cdffb9d78-6qjf8
02:10:11	openshift-ingress	kubelet	payload-processing-6cdffb9d78-6qjf8	Created	Container created
02:10:11	openshift-ingress	kubelet	payload-processing-6cdffb9d78-6qjf8	Started	Container started
02:10:11	openshift-ingress	kubelet	payload-processing-6cdffb9d78-6qjf8	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:10:22	openshift-ingress	kubelet	payload-processing-55fbbbf9dc-29gp8	Killing	Stopping container payload-processing
02:10:22	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0
02:10:22	openshift-ingress	replicaset-controller	payload-processing-55fbbbf9dc	SuccessfulDelete	Deleted pod: payload-processing-55fbbbf9dc-29gp8
02:10:24	openshift-ingress	replicaset-controller	payload-processing-6dfc49d895	SuccessfulCreate	Created pod: payload-processing-6dfc49d895-nvznf
02:10:24	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-6dfc49d895 from 0 to 1
02:10:25	openshift-ingress	kubelet	payload-pre-processing-679f4c6c7c-phs2x	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:10:25	openshift-ingress	kubelet	payload-processing-6dfc49d895-nvznf	Created	Container created
02:10:25	openshift-ingress	multus	payload-processing-6dfc49d895-nvznf	AddedInterface	Add eth0 [10.134.1.65/23] from ovn-kubernetes
02:10:25	openshift-ingress	kubelet	payload-processing-6dfc49d895-nvznf	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:10:25	openshift-ingress	multus	payload-pre-processing-679f4c6c7c-phs2x	AddedInterface	Add eth0 [10.132.0.223/23] from ovn-kubernetes
02:10:25	openshift-ingress	kubelet	payload-processing-6dfc49d895-nvznf	Started	Container started
02:10:25	openshift-ingress	kubelet	payload-pre-processing-679f4c6c7c-phs2x	Created	Container created
02:10:25	openshift-ingress	kubelet	payload-pre-processing-679f4c6c7c-phs2x	Started	Container started
02:10:25	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-679f4c6c7c from 0 to 1
02:10:25	openshift-ingress	replicaset-controller	payload-pre-processing-679f4c6c7c	SuccessfulCreate	Created pod: payload-pre-processing-679f4c6c7c-phs2x
02:10:36	openshift-ingress	replicaset-controller	payload-processing-6cdffb9d78	SuccessfulDelete	Deleted pod: payload-processing-6cdffb9d78-6qjf8
02:10:36	openshift-ingress	kubelet	payload-processing-6cdffb9d78-6qjf8	Killing	Stopping container payload-processing
02:10:36	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled down replica set payload-processing-6cdffb9d78 from 1 to 0
02:10:37	openshift-ingress	replicaset-controller	payload-pre-processing-78b8657c54	SuccessfulDelete	Deleted pod: payload-pre-processing-78b8657c54-mttsl
02:10:37	openshift-ingress	kubelet	payload-pre-processing-78b8657c54-mttsl	Killing	Stopping container payload-pre-processing
02:10:37	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled down replica set payload-pre-processing-78b8657c54 from 1 to 0
02:17:38	openshift-ingress	gateway_labeler_controller	e2e-worker-single-main-dde148	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-dde148
02:17:38 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	Unhealthy	Readiness probe failed: Get "http://10.134.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:17:38 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jll62	Unhealthy	Readiness probe failed: Get "http://10.134.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:17:38	openshift-ingress	deployment-controller	e2e-worker-single-main-dde148-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-single-main-dde148-openshift-default-84fd65479c from 0 to 1
02:17:38 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	ProbeError	Readiness probe error: Get "http://10.132.0.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:17:38	openshift-ingress	replicaset-controller	e2e-worker-single-main-dde148-openshift-default-84fd65479c	SuccessfulCreate	Created pod: e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp
02:17:38 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-jll62	ProbeError	Readiness probe error: Get "http://10.134.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:17:38 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	Unhealthy	Readiness probe failed: Get "http://10.132.0.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:17:38 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	ProbeError	Readiness probe error: Get "http://10.134.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:17:39	openshift-ingress	multus	e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	AddedInterface	Add eth0 [10.134.1.67/23] from ovn-kubernetes
02:17:46 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-single-main-dde148-6fc885894c	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-single-main-dde148-6fc885894c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-dde148: serviceaccount "payload-processing-e2e-worker-single-main-dde148" not found
02:17:46	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-single-main-dde148	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-single-main-dde148-6fc885894c from 0 to 1
02:17:46 (x7)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-single-main-dde148-6b9b98fb75	FailedCreate	Error creating: pods "payload-processing-e2e-worker-single-main-dde148-6b9b98fb75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-dde148: serviceaccount "payload-processing-e2e-worker-single-main-dde148" not found
02:17:46	openshift-ingress	deployment-controller	payload-processing-e2e-worker-single-main-dde148	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-single-main-dde148-6b9b98fb75 from 0 to 1
02:17:47	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh	Started	Container started
02:17:47	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-single-main-dde148-6b9b98fb75	SuccessfulCreate	Created pod: payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh
02:17:47	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:17:47	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-single-main-dde148-6fc885894c	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl
02:17:47	openshift-ingress	multus	payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl	AddedInterface	Add eth0 [10.132.0.240/23] from ovn-kubernetes
02:17:47	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl	Pulled	Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
02:17:47	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh	Created	Container created
02:17:47	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl	Started	Container started
02:17:47	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl	Created	Container created
02:17:47	openshift-ingress	multus	payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh	AddedInterface	Add eth0 [10.132.0.241/23] from ovn-kubernetes
02:18:05 (x2)	openshift-ingress	kubelet	e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	Started	Container started
02:18:05 (x2)	openshift-ingress	kubelet	e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
02:18:05 (x2)	openshift-ingress	kubelet	e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	Created	Container created
02:18:08	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-single-main-dde148 namespace
02:18:09 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-dde148-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
02:18:09 (x2)	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-dde148-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
02:18:10 (x5)	openshift-ingress	kubelet	e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	Unhealthy	Startup probe failed: Get "http://10.134.1.67:15021/healthz/ready": dial tcp 10.134.1.67:15021: connect: connection refused
02:18:10 (x5)	openshift-ingress	kubelet	e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	ProbeError	Startup probe error: Get "http://10.134.1.67:15021/healthz/ready": dial tcp 10.134.1.67:15021: connect: connection refused body:
02:18:24	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-dde148-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
02:18:24	openshift-ingress	horizontal-pod-autoscaler	e2e-worker-single-main-dde148-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
02:19:21	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh	Killing	Stopping container payload-processing
02:19:21	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl	Killing	Stopping container payload-pre-processing
02:19:39 (x2)	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-single-main-dde148-6fc88r5gxl	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
02:19:39 (x2)	openshift-ingress	kubelet	payload-processing-e2e-worker-single-main-dde148-6b9b98fb7h2cjh	Unhealthy	Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
02:19:56 (x2)	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-single-main-dde148 namespace
02:20:29	openshift-ingress	kubelet	e2e-worker-single-main-dde148-openshift-default-84fd65479cf7vmp	Killing	Stopping container istio-proxy
02:20:50	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0
02:20:50	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-678d87766f	SuccessfulDelete	Deleted pod: kuadrant-operator-controller-manager-678d87766f-7kk5k
02:20:50	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-7kk5k	Killing	Stopping container manager
02:21:54	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-9fr6h	Pulled	Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
02:21:54	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-678d87766f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-678d87766f-9fr6h
02:21:54	kuadrant-system	multus	kuadrant-operator-controller-manager-678d87766f-9fr6h	AddedInterface	Add eth0 [10.132.0.246/23] from ovn-kubernetes
02:21:54 (x2)	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1
02:21:55	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-9fr6h	Started	Container started
02:21:55	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-9fr6h	Created	Container created
02:22:07 (x2)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallSucceeded	install strategy completed with no errors
02:22:11	kuadrant-system	kuadrant-operator-controller-manager-678d87766f-9fr6h_41792fe7-c734-4d07-b21a-14d10548eb18	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-678d87766f-9fr6h_41792fe7-c734-4d07-b21a-14d10548eb18 became leader
02:23:11 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	Unhealthy	Readiness probe failed: Get "http://10.133.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:23:11 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	ProbeError	Readiness probe error: Get "http://10.133.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:27:26 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	Unhealthy	Readiness probe failed: Get "http://10.134.1.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:27:26 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	ProbeError	Readiness probe error: Get "http://10.133.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:27:26 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	ProbeError	Readiness probe error: Get "http://10.134.1.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:27:26 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	Unhealthy	Readiness probe failed: Get "http://10.134.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:27:26 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	ProbeError	Readiness probe error: Get "http://10.134.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:27:26 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	Unhealthy	Readiness probe failed: Get "http://10.133.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:27:26 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	Unhealthy	Readiness probe failed: Get "http://10.133.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:27:26 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	ProbeError	Readiness probe error: Get "http://10.133.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:27:57	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	ProbeError	Readiness probe error: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:27:57	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	Unhealthy	Readiness probe failed: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:27:57 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	ProbeError	Readiness probe error: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
02:27:57 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	Unhealthy	Readiness probe failed: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
02:30:00	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-must-gather-bmbxf namespace
02:30:00	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-must-gather-zlkhq namespace
02:30:00	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-must-gather-6txh6 namespace
02:32:08	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-lock	LeaderElection	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24_c3ec69f0-faf4-49df-bcb4-7b9b13608df7 stopped leading
02:32:08	openshift-service-ca-operator	service-ca-operator	service-ca-operator-lock	LeaderElection	service-ca-operator-544d749c8c-bkjl8_dedee0b4-e02c-4551-a747-f615290b9d9d stopped leading
02:32:51	openshift-multus	node-controller	multus-additional-cni-plugins-mf6df	NodeNotReady	Node is not ready
02:32:51	kuadrant-system	node-controller	limitador-operator-controller-manager-5778bb4449-7hsnc	NodeNotReady	Node is not ready
02:32:51	openshift-network-diagnostics	node-controller	network-check-target-9xnql	NodeNotReady	Node is not ready
02:32:51	openshift-cluster-samples-operator	node-controller	cluster-samples-operator-6ddb6c8b94-nq7ch	NodeNotReady	Node is not ready
02:32:51	openshift-network-diagnostics	node-controller	network-check-target-8km4w	NodeNotReady	Node is not ready
02:32:51	opendatahub	node-controller	kserve-module-controller-manager-7566cf5fc8-s59js	NodeNotReady	Node is not ready
02:32:51	openshift-dns	node-controller	dns-default-6p5xt	NodeNotReady	Node is not ready
02:32:51	openshift-dns	node-controller	node-resolver-fkt8d	NodeNotReady	Node is not ready
02:32:51	openshift-network-diagnostics	node-controller	network-check-source-6f78d59f99-knrbl	NodeNotReady	Node is not ready
02:32:51	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-fr8bl	NodeNotReady	Node is not ready
02:32:51	openshift-kube-storage-version-migrator	node-controller	migrator-66df5d496b-tbzhs	NodeNotReady	Node is not ready
02:32:51	openshift-kube-storage-version-migrator-operator	node-controller	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	NodeNotReady	Node is not ready
02:32:51	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-btqmg	NodeNotReady	Node is not ready
02:32:51	openshift-cluster-csi-drivers	node-controller	aws-ebs-csi-driver-node-8h5z9	NodeNotReady	Node is not ready
02:32:51	openshift-multus	node-controller	network-metrics-daemon-2vxt5	NodeNotReady	Node is not ready
02:32:51	openshift-monitoring	node-controller	monitoring-plugin-77f4f76594-dbkds	NodeNotReady	Node is not ready
02:32:51	openshift-monitoring	node-controller	cluster-monitoring-operator-884576c57-nqmlz	NodeNotReady	Node is not ready
02:32:51	openshift-service-ca-operator	node-controller	service-ca-operator-544d749c8c-bkjl8	NodeNotReady	Node is not ready
02:32:51	openshift-network-operator	node-controller	iptables-alerter-zpf48	NodeNotReady	Node is not ready
02:32:51	kuadrant-system	node-controller	authorino-6f48f74795-6sh8x	NodeNotReady	Node is not ready
02:32:52	openshift-cluster-csi-drivers	node-controller	aws-ebs-csi-driver-node-pjnxn	NodeNotReady	Node is not ready
02:32:52	opendatahub	node-controller	kserve-controller-manager-776cc66d47-cpp7f	NodeNotReady	Node is not ready
02:32:52	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-8jgw5	NodeNotReady	Node is not ready
02:32:52	kuadrant-system	node-controller	kuadrant-console-plugin-66c4fb575d-ngn8q	NodeNotReady	Node is not ready
02:32:52	openshift-monitoring	node-controller	prometheus-k8s-0	NodeNotReady	Node is not ready
02:32:52	openshift-network-operator	node-controller	iptables-alerter-h22zx	NodeNotReady	Node is not ready
02:32:52	kuadrant-system	node-controller	kuadrant-operator-controller-manager-678d87766f-9fr6h	NodeNotReady	Node is not ready
02:32:52	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	NodeNotReady	Node is not ready
02:32:52	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	ComponentUnhealthy	installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:52	openshift-ingress	node-controller	payload-pre-processing-679f4c6c7c-phs2x	NodeNotReady	Node is not ready
02:32:52	kuadrant-system	node-controller	limitador-limitador-7c9b87d574-9jgw7	NodeNotReady	Node is not ready
02:32:52	openshift-monitoring	node-controller	prometheus-operator-9cd89b74c-zw4f5	NodeNotReady	Node is not ready
02:32:52	openshift-network-console	node-controller	networking-console-plugin-86c478bb88-v4tzv	NodeNotReady	Node is not ready
02:32:52	openshift-ingress	node-controller	router-default-b48ff49b9-v8tjs	NodeNotReady	Node is not ready
02:32:52	openshift-ingress-canary	node-controller	ingress-canary-9vqsh	NodeNotReady	Node is not ready
02:32:52 (x2)	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	AllRequirementsMet	all requirements found, attempting install
02:32:52 (x2)	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallSucceeded	waiting for install components to report healthy
02:32:52	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	NodeNotReady	Node is not ready
02:32:52	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	ComponentUnhealthy	installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:52	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	NeedsReinstall	installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:52	openshift-ingress	node-controller	data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8	NodeNotReady	Node is not ready
02:32:52	openshift-image-registry	node-controller	node-ca-qdq6c	NodeNotReady	Node is not ready
02:32:52	openshift-ingress-canary	node-controller	ingress-canary-bq5tp	NodeNotReady	Node is not ready
02:32:52	openshift-image-registry	node-controller	node-ca-2jtx2	NodeNotReady	Node is not ready
02:32:52	openshift-multus	node-controller	multus-mw7mj	NodeNotReady	Node is not ready
02:32:52	openshift-ingress	node-controller	kube-auth-proxy-5d55d55f6d-h897p	NodeNotReady	Node is not ready
02:32:52	openshift-monitoring	node-controller	node-exporter-865h2	NodeNotReady	Node is not ready
02:32:52	openshift-ovn-kubernetes	node-controller	ovnkube-node-wlldw	NodeNotReady	Node is not ready
02:32:52	openshift-image-registry	node-controller	image-registry-d98c5d7fb-9p5s7	NodeNotReady	Node is not ready
02:32:52	openshift-insights	node-controller	insights-runtime-extractor-xhcgv	NodeNotReady	Node is not ready
02:32:52	openshift-dns	node-controller	node-resolver-w7sds	NodeNotReady	Node is not ready
02:32:52	kuadrant-system	node-controller	dns-operator-controller-manager-8557cbdb84-9m7mp	NodeNotReady	Node is not ready
02:32:52	opendatahub-operator-system	node-controller	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	NodeNotReady	Node is not ready
02:32:52	opendatahub	node-controller	ai-gateway-controller-8967cc4f-x2fc2	NodeNotReady	Node is not ready
02:32:52	openshift-dns	node-controller	dns-default-b75ck	NodeNotReady	Node is not ready
02:32:52	opendatahub-operator-system	node-controller	opendatahub-operator-controller-manager-6b5d59bb59-n8ht5	NodeNotReady	Node is not ready
02:32:52	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	NeedsReinstall	installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
02:32:52	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	ComponentUnhealthy	installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
02:32:52	opendatahub	node-controller	llmisvc-controller-manager-6466c554d8-g82lt	NodeNotReady	Node is not ready
02:32:52	openshift-insights	node-controller	insights-operator-7c4986d449-8x7tk	NodeNotReady	Node is not ready
02:32:52	openshift-console-operator	node-controller	console-operator-7cd56b8dbc-bwtwg	NodeNotReady	Node is not ready
02:32:52	openshift-kube-storage-version-migrator	node-controller	migrator-66df5d496b-k4jqv	NodeNotReady	Node is not ready
02:32:52	opendatahub	node-controller	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	NodeNotReady	Node is not ready
02:32:52	openshift-multus	node-controller	network-metrics-daemon-gqvhh	NodeNotReady	Node is not ready
02:32:52	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	NodeNotReady	Node is not ready
02:32:52	openshift-cluster-storage-operator	node-controller	volume-data-source-validator-58c9f5f46d-6hgmr	NodeNotReady	Node is not ready
02:32:52	openshift-jobset-operator	node-controller	jobset-operator-674cd59dc5-tn9c7	NodeNotReady	Node is not ready
02:32:52	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	NeedsReinstall	installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.
02:32:52	kuadrant-system	node-controller	authorino-operator-7b7bb4bc77-zr6mf	NodeNotReady	Node is not ready
02:32:52	opendatahub	node-controller	maas-controller-c6c5b9684-7w7mh	NodeNotReady	Node is not ready
02:32:52	openshift-multus	node-controller	multus-additional-cni-plugins-wcpdn	NodeNotReady	Node is not ready
02:32:52	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	ComponentUnhealthy	installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.
02:32:52	openshift-cluster-node-tuning-operator	node-controller	tuned-d6cwn	NodeNotReady	Node is not ready
02:32:52	openshift-cluster-node-tuning-operator	node-controller	tuned-9mfzm	NodeNotReady	Node is not ready
02:32:52	openshift-ingress	node-controller	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	NodeNotReady	Node is not ready
02:32:52	openshift-monitoring	node-controller	node-exporter-7k7nh	NodeNotReady	Node is not ready
02:32:52	openshift-multus	node-controller	multus-cxrhl	NodeNotReady	Node is not ready
02:32:52	openshift-insights	node-controller	insights-runtime-extractor-jbbjm	NodeNotReady	Node is not ready
02:32:52	opendatahub	node-controller	odh-model-controller-769875db56-mn6tc	NodeNotReady	Node is not ready
02:32:52	opendatahub	node-controller	model-serving-api-75bd89fdfc-xm5x8	NodeNotReady	Node is not ready
02:32:52 (x2)	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	AllRequirementsMet	all requirements found, attempting install
02:32:52	openshift-ovn-kubernetes	node-controller	ovnkube-node-qmx5k	NodeNotReady	Node is not ready
02:32:53	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	ComponentUnhealthy	installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:53 (x2)	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	InstallSucceeded	waiting for install components to report healthy
02:32:53 (x2)	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	AllRequirementsMet	all requirements found, attempting install
02:32:53 (x2)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	NeedsReinstall	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:53 (x2)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	ComponentUnhealthy	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:53 (x3)	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallWaiting	installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:53	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	NeedsReinstall	installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:54 (x2)	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallSucceeded	waiting for install components to report healthy
02:32:54 (x3)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	AllRequirementsMet	all requirements found, attempting install
02:32:54 (x2)	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	AllRequirementsMet	all requirements found, attempting install
02:32:54 (x2)	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallWaiting	installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
02:32:54 (x3)	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	InstallWaiting	installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.
02:32:55 (x3)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallWaiting	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:55 (x2)	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallWaiting	installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:55 (x2)	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallSucceeded	waiting for install components to report healthy
02:32:55	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	NeedsReinstall	installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
02:32:55 (x3)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallSucceeded	waiting for install components to report healthy
02:32:56 (x4)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	AllRequirementsMet	all requirements found, attempting install
02:32:57	openshift-monitoring	node-controller	kube-state-metrics-5dc8d7d89b-m4669	NodeNotReady	Node is not ready
02:32:57	openshift-monitoring	node-controller	node-exporter-qxqvx	NodeNotReady	Node is not ready
02:32:57	openshift-monitoring	node-controller	metrics-server-547554f588-2ksph	NodeNotReady	Node is not ready
02:32:57	openshift-service-ca	node-controller	service-ca-5fffc97bdf-9jbck	NodeNotReady	Node is not ready
02:32:57	openshift-console	node-controller	console-79f9c6b794-jzhvk	NodeNotReady	Node is not ready
02:32:57 (x4)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	InstallSucceeded	waiting for install components to report healthy
02:32:57	openshift-monitoring	node-controller	telemeter-client-5d5dd7655d-nknlw	NodeNotReady	Node is not ready
02:32:58	opendatahub	taint-eviction-controller	kserve-module-controller-manager-7566cf5fc8-s59js	TaintManagerEviction	Cancelling deletion of Pod opendatahub/kserve-module-controller-manager-7566cf5fc8-s59js
02:32:58	kuadrant-system	taint-eviction-controller	kuadrant-operator-controller-manager-678d87766f-9fr6h	TaintManagerEviction	Cancelling deletion of Pod kuadrant-system/kuadrant-operator-controller-manager-678d87766f-9fr6h
02:32:58	openshift-ingress	taint-eviction-controller	maas-default-gateway-openshift-default-848f6bf8bc-ht7vt	TaintManagerEviction	Cancelling deletion of Pod openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-ht7vt
02:32:58	kuadrant-system	taint-eviction-controller	authorino-6f48f74795-6sh8x	TaintManagerEviction	Cancelling deletion of Pod kuadrant-system/authorino-6f48f74795-6sh8x
02:32:58	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-wq4dx	NodeNotReady	Node is not ready
02:32:58	kuadrant-system	taint-eviction-controller	authorino-operator-7b7bb4bc77-zr6mf	TaintManagerEviction	Cancelling deletion of Pod kuadrant-system/authorino-operator-7b7bb4bc77-zr6mf
02:32:58	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-ftq6n	NodeNotReady	Node is not ready
02:32:58	openshift-ingress	taint-eviction-controller	openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt	TaintManagerEviction	Cancelling deletion of Pod openshift-ingress/openshift-ai-inference-openshift-ai-inference-597546666c-f6qwt
02:32:58	kuadrant-system	taint-eviction-controller	dns-operator-controller-manager-8557cbdb84-9m7mp	TaintManagerEviction	Cancelling deletion of Pod kuadrant-system/dns-operator-controller-manager-8557cbdb84-9m7mp
02:32:58	openshift-multus	node-controller	multus-additional-cni-plugins-2ckv6	NodeNotReady	Node is not ready
02:32:58	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-cldnc	NodeNotReady	Node is not ready
02:32:58	openshift-multus	node-controller	multus-4rhrt	NodeNotReady	Node is not ready
02:32:58	openshift-ingress	node-controller	istiod-openshift-gateway-7ddd9cfdc8-9s6rb	NodeNotReady	Node is not ready
02:32:58	openshift-monitoring	taint-eviction-controller	cluster-monitoring-operator-884576c57-nqmlz	TaintManagerEviction	Cancelling deletion of Pod openshift-monitoring/cluster-monitoring-operator-884576c57-nqmlz
02:32:58	openshift-monitoring	node-controller	thanos-querier-5dbf58b5cd-c6sjm	NodeNotReady	Node is not ready
02:32:58	openshift-ingress	node-controller	payload-processing-6dfc49d895-nvznf	NodeNotReady	Node is not ready
02:32:58	openshift-multus	node-controller	network-metrics-daemon-jw8gx	NodeNotReady	Node is not ready
02:32:58	openshift-ingress	taint-eviction-controller	payload-pre-processing-679f4c6c7c-phs2x	TaintManagerEviction	Cancelling deletion of Pod openshift-ingress/payload-pre-processing-679f4c6c7c-phs2x
02:32:58	openshift-monitoring	node-controller	openshift-state-metrics-7bd7489957-jnhj4	NodeNotReady	Node is not ready
02:32:58	openshift-monitoring	node-controller	alertmanager-main-0	NodeNotReady	Node is not ready
02:32:58	openshift-service-ca-operator	taint-eviction-controller	service-ca-operator-544d749c8c-bkjl8	TaintManagerEviction	Cancelling deletion of Pod openshift-service-ca-operator/service-ca-operator-544d749c8c-bkjl8
02:32:58	openshift-ingress	taint-eviction-controller	router-default-b48ff49b9-v8tjs	TaintManagerEviction	Cancelling deletion of Pod openshift-ingress/router-default-b48ff49b9-v8tjs
02:32:58	openshift-ingress	taint-eviction-controller	maas-default-gateway-openshift-default-848f6bf8bc-b5rh5	TaintManagerEviction	Cancelling deletion of Pod openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-b5rh5
02:32:58	openshift-kube-storage-version-migrator-operator	taint-eviction-controller	kube-storage-version-migrator-operator-7d4bc45dd6-h2t24	TaintManagerEviction	Cancelling deletion of Pod openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h2t24
02:32:58	openshift-ingress	taint-eviction-controller	maas-default-gateway-openshift-default-848f6bf8bc-2s8jj	TaintManagerEviction	Cancelling deletion of Pod openshift-ingress/maas-default-gateway-openshift-default-848f6bf8bc-2s8jj
02:32:58	openshift-monitoring	node-controller	prometheus-operator-admission-webhook-6489d8bf89-cnzm7	NodeNotReady	Node is not ready
02:32:58	openshift-ovn-kubernetes	node-controller	ovnkube-node-gzk2m	NodeNotReady	Node is not ready
02:32:58	openshift-network-console	taint-eviction-controller	networking-console-plugin-86c478bb88-v4tzv	TaintManagerEviction	Cancelling deletion of Pod openshift-network-console/networking-console-plugin-86c478bb88-v4tzv
02:32:58	kuadrant-system	taint-eviction-controller	limitador-operator-controller-manager-5778bb4449-7hsnc	TaintManagerEviction	Cancelling deletion of Pod kuadrant-system/limitador-operator-controller-manager-5778bb4449-7hsnc
02:32:58	openshift-ingress-canary	node-controller	ingress-canary-qg288	NodeNotReady	Node is not ready
02:32:58	openshift-ingress	taint-eviction-controller	data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8	TaintManagerEviction	Cancelling deletion of Pod openshift-ingress/data-science-gateway-data-science-gateway-class-6bc49dd89-qwbj8
02:32:58	openshift-image-registry	node-controller	node-ca-2l6ct	NodeNotReady	Node is not ready
02:32:58	openshift-ingress	node-controller	kube-auth-proxy-5d55d55f6d-xsfmv	NodeNotReady	Node is not ready
02:32:58	openshift-kube-storage-version-migrator	taint-eviction-controller	migrator-66df5d496b-k4jqv	TaintManagerEviction	Cancelling deletion of Pod openshift-kube-storage-version-migrator/migrator-66df5d496b-k4jqv
02:32:58	openshift-insights	taint-eviction-controller	insights-operator-7c4986d449-8x7tk	TaintManagerEviction	Cancelling deletion of Pod openshift-insights/insights-operator-7c4986d449-8x7tk
02:32:58	openshift-network-diagnostics	taint-eviction-controller	network-check-source-6f78d59f99-knrbl	TaintManagerEviction	Cancelling deletion of Pod openshift-network-diagnostics/network-check-source-6f78d59f99-knrbl
02:32:58	opendatahub	taint-eviction-controller	usage-logs-tenancy-proxy-9c5d49bcd-4ptr6	TaintManagerEviction	Cancelling deletion of Pod opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-4ptr6
02:32:58	openshift-insights	node-controller	insights-runtime-extractor-9fbs4	NodeNotReady	Node is not ready
02:32:58	openshift-dns	node-controller	node-resolver-9lcsd	NodeNotReady	Node is not ready
02:32:58	opendatahub	taint-eviction-controller	odh-model-controller-769875db56-mn6tc	TaintManagerEviction	Cancelling deletion of Pod opendatahub/odh-model-controller-769875db56-mn6tc
02:32:58	openshift-network-operator	node-controller	iptables-alerter-mgskf	NodeNotReady	Node is not ready
02:32:58	opendatahub	taint-eviction-controller	ai-gateway-controller-8967cc4f-x2fc2	TaintManagerEviction	Cancelling deletion of Pod opendatahub/ai-gateway-controller-8967cc4f-x2fc2
02:32:58	openshift-dns	node-controller	dns-default-9v4jh	NodeNotReady	Node is not ready
02:32:58	opendatahub-operator-system	node-controller	opendatahub-operator-controller-manager-6b5d59bb59-khdbh	NodeNotReady	Node is not ready
02:32:58	opendatahub-operator-system	taint-eviction-controller	opendatahub-operator-controller-manager-6b5d59bb59-n2w5c	TaintManagerEviction	Cancelling deletion of Pod opendatahub-operator-system/opendatahub-operator-controller-manager-6b5d59bb59-n2w5c
02:32:58	opendatahub	taint-eviction-controller	kserve-controller-manager-776cc66d47-cpp7f	TaintManagerEviction	Cancelling deletion of Pod opendatahub/kserve-controller-manager-776cc66d47-cpp7f
02:32:58	openshift-ingress	node-controller	maas-default-gateway-openshift-default-848f6bf8bc-jll62	NodeNotReady	Node is not ready
02:32:58	openshift-console-operator	taint-eviction-controller	console-operator-7cd56b8dbc-bwtwg	TaintManagerEviction	Cancelling deletion of Pod openshift-console-operator/console-operator-7cd56b8dbc-bwtwg
02:32:58	openshift-console	node-controller	downloads-6dd789c8b7-g6lwk	NodeNotReady	Node is not ready
02:32:58	openshift-insights	taint-eviction-controller	periodic-gathering-fm2r2-k668x	TaintManagerEviction	Cancelling deletion of Pod openshift-insights/periodic-gathering-fm2r2-k668x
02:32:58	openshift-cluster-storage-operator	taint-eviction-controller	volume-data-source-validator-58c9f5f46d-6hgmr	TaintManagerEviction	Cancelling deletion of Pod openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-6hgmr
02:32:58	openshift-jobset-operator	node-controller	jobset-controller-manager-5dc75844c9-skm5b	NodeNotReady	Node is not ready
02:32:58	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Available changed from True to False ("AWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service")
02:32:58	openshift-cluster-samples-operator	taint-eviction-controller	cluster-samples-operator-6ddb6c8b94-nq7ch	TaintManagerEviction	Cancelling deletion of Pod openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nq7ch
02:32:58	openshift-jobset-operator	taint-eviction-controller	jobset-operator-674cd59dc5-tn9c7	TaintManagerEviction	Cancelling deletion of Pod openshift-jobset-operator/jobset-operator-674cd59dc5-tn9c7
02:32:58	opendatahub	taint-eviction-controller	maas-controller-c6c5b9684-7w7mh	TaintManagerEviction	Cancelling deletion of Pod opendatahub/maas-controller-c6c5b9684-7w7mh
02:32:58	openshift-cluster-node-tuning-operator	node-controller	tuned-mdc9b	NodeNotReady	Node is not ready
02:32:58	openshift-network-diagnostics	node-controller	network-check-target-nj7c4	NodeNotReady	Node is not ready
02:32:58	openshift-cluster-csi-drivers	node-controller	aws-ebs-csi-driver-node-g96m5	NodeNotReady	Node is not ready
02:32:59 (x4)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	InstallWaiting	installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
02:33:19 (x5)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
02:33:19 (x2)	openshift-ingress	service-controller	openshift-ai-inference-openshift-ai-inference	UpdatedLoadBalancer	Updated load balancer with new hosts
02:34:10	opendatahub	replicaset-controller	llmisvc-controller-manager-6466c554d8	SuccessfulCreate	Created pod: llmisvc-controller-manager-6466c554d8-tqkk8
02:34:10	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-6bc49dd89	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-6bc49dd89-tdzrq
02:34:11	openshift-monitoring	replicaset-controller	monitoring-plugin-77f4f76594	SuccessfulCreate	Created pod: monitoring-plugin-77f4f76594-xtpk9
02:34:11	kuadrant-system	replicaset-controller	authorino-6f48f74795	SuccessfulCreate	Created pod: authorino-6f48f74795-w4zvt
02:34:11	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-5k49j
02:34:11	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: [skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-fr8bl for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-btqmg for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-ht7vt for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found]
02:34:11	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-mn7vh
02:34:11	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-vldr9
02:34:11	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-6b5d59bb59	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-6b5d59bb59-7vj9v
02:34:11	openshift-ingress	replicaset-controller	openshift-ai-inference-openshift-ai-inference-597546666c	SuccessfulCreate	Created pod: openshift-ai-inference-openshift-ai-inference-597546666c-nwk5r
02:34:11	opendatahub	replicaset-controller	kserve-controller-manager-776cc66d47	SuccessfulCreate	Created pod: kserve-controller-manager-776cc66d47-qjj9n
02:34:11	openshift-kube-storage-version-migrator	replicaset-controller	migrator-66df5d496b	SuccessfulCreate	Created pod: migrator-66df5d496b-hwmkt
02:34:11	opendatahub	replicaset-controller	usage-logs-tenancy-proxy-9c5d49bcd	SuccessfulCreate	Created pod: usage-logs-tenancy-proxy-9c5d49bcd-l7v66
02:34:11	kuadrant-system	replicaset-controller	dns-operator-controller-manager-8557cbdb84	SuccessfulCreate	Created pod: dns-operator-controller-manager-8557cbdb84-489f6
02:34:11	opendatahub	replicaset-controller	model-serving-api-75bd89fdfc	SuccessfulCreate	Created pod: model-serving-api-75bd89fdfc-prfv5
02:34:11	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-58c9f5f46d	SuccessfulCreate	Created pod: volume-data-source-validator-58c9f5f46d-r6ttl
02:34:11	opendatahub	replicaset-controller	odh-model-controller-769875db56	SuccessfulCreate	Created pod: odh-model-controller-769875db56-mzcn9
02:34:11	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: [skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-ht7vt for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-fr8bl for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found]
02:34:11	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: [skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-ht7vt for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-fr8bl for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-b5rh5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-btqmg for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found]
02:34:11	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: [skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-fr8bl for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-b5rh5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-btqmg for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-ht7vt for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found]
02:34:11	openshift-ingress	replicaset-controller	router-default-b48ff49b9	SuccessfulCreate	Created pod: router-default-b48ff49b9-f25xg
02:34:11 (x2)	openshift-monitoring	endpoint-slice-controller	node-exporter	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-monitoring/node-exporter: skipping Pod node-exporter-7k7nh for Service openshift-monitoring/node-exporter: Node ip-10-0-131-66.us-west-1.compute.internal Not Found
02:34:11 (x2)	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: [skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-fr8bl for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-ht7vt for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found]
02:34:11 (x3)	openshift-ingress-canary	endpoint-slice-controller	ingress-canary	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress-canary/ingress-canary: skipping Pod ingress-canary-9vqsh for Service openshift-ingress-canary/ingress-canary: Node ip-10-0-131-66.us-west-1.compute.internal Not Found
02:34:11	openshift-jobset-operator	replicaset-controller	jobset-operator-674cd59dc5	SuccessfulCreate	Created pod: jobset-operator-674cd59dc5-82w5q
02:34:11 (x2)	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: [skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-btqmg for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-ht7vt for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-fr8bl for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found]
02:34:11	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-678d87766f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-678d87766f-v7q9j
02:34:12 (x3)	openshift-monitoring	statefulset-controller	prometheus-k8s	SuccessfulCreate	Create Pod prometheus-k8s-0 in StatefulSet prometheus-k8s successful
02:34:12	kuadrant-system	replicaset-controller	kuadrant-console-plugin-66c4fb575d	SuccessfulCreate	Created pod: kuadrant-console-plugin-66c4fb575d-qlttz
02:34:12 (x2)	openshift-network-diagnostics	endpoint-slice-controller	network-check-target	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-network-diagnostics/network-check-target: skipping Pod network-check-target-9xnql for Service openshift-network-diagnostics/network-check-target: Node ip-10-0-134-148.us-west-1.compute.internal Not Found
02:34:12 (x4)	opendatahub-operator-system	endpoint-slice-controller	opendatahub-operator-controller-manager-service	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service opendatahub-operator-system/opendatahub-operator-controller-manager-service: skipping Pod opendatahub-operator-controller-manager-6b5d59bb59-n8ht5 for Service opendatahub-operator-system/opendatahub-operator-controller-manager-service: Node ip-10-0-131-66.us-west-1.compute.internal Not Found
02:34:12 (x4)	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: [skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found, skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-ht7vt for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found]
02:34:12 (x3)	openshift-ingress	endpoint-slice-controller	maas-default-gateway-openshift-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-ingress/maas-default-gateway-openshift-default: skipping Pod maas-default-gateway-openshift-default-848f6bf8bc-8jgw5 for Service openshift-ingress/maas-default-gateway-openshift-default: Node ip-10-0-131-66.us-west-1.compute.internal Not Found
02:34:12 (x4)	opendatahub-operator-system	endpoint-slice-controller	opendatahub-operator-controller-manager-metrics-service	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service opendatahub-operator-system/opendatahub-operator-controller-manager-metrics-service: skipping Pod opendatahub-operator-controller-manager-6b5d59bb59-n8ht5 for Service opendatahub-operator-system/opendatahub-operator-controller-manager-metrics-service: Node ip-10-0-131-66.us-west-1.compute.internal Not Found
02:34:12	openshift-monitoring	replicaset-controller	prometheus-operator-9cd89b74c	SuccessfulCreate	Created pod: prometheus-operator-9cd89b74c-hpcfw
02:34:12	openshift-network-console	replicaset-controller	networking-console-plugin-86c478bb88	SuccessfulCreate	Created pod: networking-console-plugin-86c478bb88-lrdfn
02:34:12	opendatahub	replicaset-controller	kserve-module-controller-manager-7566cf5fc8	SuccessfulCreate	Created pod: kserve-module-controller-manager-7566cf5fc8-mlbt7
02:34:12	openshift-kube-storage-version-migrator	replicaset-controller	migrator-66df5d496b	SuccessfulCreate	Created pod: migrator-66df5d496b-b7tbt
02:34:12	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-xgdjg
02:34:12	opendatahub	replicaset-controller	ai-gateway-controller-8967cc4f	SuccessfulCreate	Created pod: ai-gateway-controller-8967cc4f-khgds
02:34:12	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-dzhvl
02:34:12 (x2)	openshift-image-registry	controllermanager	image-registry	NoPods	No matching pods found
02:34:12 (x3)	openshift-dns	endpoint-slice-controller	dns-default	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-dns/dns-default: skipping Pod dns-default-6p5xt for Service openshift-dns/dns-default: Node ip-10-0-134-148.us-west-1.compute.internal Not Found
02:34:12 (x3)	openshift-multus	endpoint-slice-controller	network-metrics-service	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-multus/network-metrics-service: skipping Pod network-metrics-daemon-2vxt5 for Service openshift-multus/network-metrics-service: Node ip-10-0-131-66.us-west-1.compute.internal Not Found
02:34:12	openshift-image-registry	replicaset-controller	image-registry-d98c5d7fb	SuccessfulCreate	Created pod: image-registry-d98c5d7fb-bq2b8
02:34:12	openshift-monitoring	statefulset-controller	prometheus-k8s	FailedDelete	Delete Pod prometheus-k8s-0 in StatefulSet prometheus-k8s failed error: pods "prometheus-k8s-0" not found
02:34:12	openshift-ingress	replicaset-controller	payload-pre-processing-679f4c6c7c	SuccessfulCreate	Created pod: payload-pre-processing-679f4c6c7c-pqr5j
02:34:12	openshift-service-ca-operator	replicaset-controller	service-ca-operator-544d749c8c	SuccessfulCreate	Created pod: service-ca-operator-544d749c8c-5bwfp
02:34:12	openshift-network-diagnostics	replicaset-controller	network-check-source-6f78d59f99	SuccessfulCreate	Created pod: network-check-source-6f78d59f99-7zvhb
02:34:13	openshift-insights	replicaset-controller	insights-operator-7c4986d449	SuccessfulCreate	Created pod: insights-operator-7c4986d449-8h685
02:34:13	opendatahub	replicaset-controller	maas-controller-c6c5b9684	SuccessfulCreate	Created pod: maas-controller-c6c5b9684-47s69
02:34:13	openshift-ingress	replicaset-controller	kube-auth-proxy-5d55d55f6d	SuccessfulCreate	Created pod: kube-auth-proxy-5d55d55f6d-ltxrk
02:34:13	kuadrant-system	replicaset-controller	limitador-operator-controller-manager-5778bb4449	SuccessfulCreate	Created pod: limitador-operator-controller-manager-5778bb4449-v9f8f
02:34:13	openshift-kube-storage-version-migrator-operator	replicaset-controller	kube-storage-version-migrator-operator-7d4bc45dd6	SuccessfulCreate	Created pod: kube-storage-version-migrator-operator-7d4bc45dd6-97z2t
02:34:13	kuadrant-system	replicaset-controller	limitador-limitador-7c9b87d574	SuccessfulCreate	Created pod: limitador-limitador-7c9b87d574-rvx7r
02:34:13	kuadrant-system	replicaset-controller	authorino-operator-7b7bb4bc77	SuccessfulCreate	Created pod: authorino-operator-7b7bb4bc77-bwqw9
02:34:13	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-848f6bf8bc	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-848f6bf8bc-4k5mv
02:34:13 (x2)	openshift-insights	endpoint-slice-controller	exporter	FailedToUpdateEndpointSlices	Error updating Endpoint Slices for Service openshift-insights/exporter: skipping Pod insights-runtime-extractor-xhcgv for Service openshift-insights/exporter: Node ip-10-0-131-66.us-west-1.compute.internal Not Found
02:34:13	openshift-monitoring	replicaset-controller	cluster-monitoring-operator-884576c57	SuccessfulCreate	Created pod: cluster-monitoring-operator-884576c57-7sbf4
02:34:13	openshift-cluster-samples-operator	replicaset-controller	cluster-samples-operator-6ddb6c8b94	SuccessfulCreate	Created pod: cluster-samples-operator-6ddb6c8b94-mbqzr
02:34:13	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-6b5d59bb59	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-6b5d59bb59-cvrqn
02:34:14	openshift-console-operator	replicaset-controller	console-operator-7cd56b8dbc	SuccessfulCreate	Created pod: console-operator-7cd56b8dbc-nplbg
02:34:19 (x9)	openshift-ingress	horizontal-pod-autoscaler	data-science-gateway-data-science-gateway-class	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:19 (x9)	openshift-ingress	horizontal-pod-autoscaler	data-science-gateway-data-science-gateway-class	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:19 (x9)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:19 (x9)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:22 (x9)	openshift-ingress	horizontal-pod-autoscaler	openshift-ai-inference-openshift-ai-inference	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:22 (x9)	openshift-ingress	horizontal-pod-autoscaler	openshift-ai-inference-openshift-ai-inference	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:26 (x10)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:26 (x10)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:28 (x10)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)
02:34:28 (x10)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server is currently unable to handle the request (get pods.metrics.k8s.io)