226 commits

Author	SHA1	Message	Date
Daan Leijen	bc5f636c5e	nicer stats	2025-03-01 19:46:01 -08:00
Daan Leijen	195249e6bf	maintain precise try count for reclaim	2025-01-07 19:28:44 -08:00
Daan	f33aa58d88	Merge branch 'dev' into dev	2024-12-30 12:27:46 -08:00
daanx	c8607a8d01	remove os_tld and stats parameters to os interface	2024-12-08 17:56:13 -08:00
daanx	7673aa2517	ensure forced abandoned pages can be accessed after free	2024-11-25 18:41:57 -08:00
daanx	9b7ac9a1a6	clean up candidate search; add mi_collect_reduce	2024-11-25 16:58:02 -08:00
daanx	71fec8caf5	add target_segments_per_thread option	2024-11-18 15:05:22 -08:00
daanx	8b6017d976	rename mi_debug_guarded_ to mi_guarded_	2024-11-16 22:42:32 -08:00
Daan Leijen	f130808b5c	fix warnings	2024-08-20 12:58:49 -07:00
daanx	635cf7af6a	fix multi-threaded free to unprotect guarded blocks	2024-08-20 09:55:57 -07:00
daanx	0c19eb60cf	initial working guarded pages	2024-08-19 21:21:40 -07:00
QuarticCat	632421da3a	fix typos	2024-06-19 10:49:03 +08:00
daanx	265767766b	fix alignment test	2024-06-17 16:22:07 -07:00
daanx	b7dd5d6564	add extra assertions to check that blocks are always aligned to MI_MAX_ALIGN_SIZE	2024-06-17 16:17:03 -07:00
daanx	b1188ea336	fix potential race on subproc field in the segment	2024-06-03 20:57:00 -07:00
daanx	065f46cefb	don't reset a segment thread id when iterating	2024-06-03 18:19:45 -07:00
daanx	96b69d7ef6	fix leak where OS abandoned blocks were not always reclaimed	2024-06-03 17:28:14 -07:00
daanx	f02a0b3541	more aggressive reclaim from free for OS blocks	2024-06-03 14:05:57 -07:00
Daan	7e23576efa	remove old mi_abandoned_await_readers	2024-06-03 09:57:03 -07:00
daanx	f9076a5cf8	use EFAULT if a target heap tag cannot be found on reclaim	2024-06-02 15:54:49 -07:00
daanx	5501f59f6c	only reclaim for exclusive heaps in their associated arena	2024-06-02 13:16:20 -07:00
daanx	8f874555d5	add initial support for visiting abandoned segments per subprocess, upstream for python/cpython#114133	2024-06-02 07:47:08 -07:00
daanx	d9aa19a763	add support for sub-processes (to supportpython/cpython#113717)	2024-06-01 15:57:18 -07:00
Daan	0c4041fa53	add support for custom heap and page tags, upstream of python/cpython#113742	2024-05-19 08:06:32 -07:00
Daan	7128db7bba	simplified aligned allocation; improved codegen; fix mi_good_size with padding included; add MI_MAX_ALIGN_GUARANTEE	2024-05-11 06:43:52 -07:00
Daan	09e91ec911	add assert for segment purges	2024-04-19 12:44:23 -07:00
Daan	bf5932c3c6	use better purging for segments_collect	2024-04-19 12:43:05 -07:00
Daan	2b7530e183	add segment_collect for forced heap_collect	2024-04-19 12:33:17 -07:00
Daan	32e065bb32	rename segment_thread_collect to segment_collect	2024-04-19 12:11:58 -07:00
Daan Leijen	460278f110	comments	2024-03-25 16:02:20 -07:00
Daan Leijen	0022802177	commend and make at least 8 tries for reclaim	2024-03-25 15:25:04 -07:00
daanx	006ae2d055	add is_huge page flag to ensure the right page queue is returned (see #868)	2024-03-24 17:07:28 -07:00
Daan Leijen	b5665f0eec	add full block_size and page_start to page info	2024-03-24 14:17:17 -07:00
Daan Leijen	6688b45fbd	rename MI_ALIGNMENT_MAX to MI_BLOCK_ALIGNMENT_MAX for clarity	2024-03-24 10:57:02 -07:00
Daan Leijen	f141ca12a4	add extra runtime check to ensure we never insert large or huge pages in the segment free queue (issue #870)	2024-03-24 10:53:39 -07:00
Daan Leijen	4f809aadb7	use free field for expiration instead of used	2024-03-24 08:29:56 -07:00
Daan	da52048025	rename local to avoid warning in static build	2024-03-03 18:08:17 -08:00
daanx	5fe83bf327	limit reclaim from free to half the segments to prevent a pure freeing thread to reclaim too many segments	2024-03-03 17:38:50 -08:00
daanx	43d40704b9	keep threadid 0 for abandoned_next to preserve invariants	2024-03-02 18:24:53 -08:00
daanx	3090f23c25	fix return value of get_reclaim_tries	2024-03-01 18:59:13 -08:00
daanx	500d2ad1fd	ensure non-arena segments are force purged on abandonment; make non-arena reclaim atomic	2024-03-01 18:47:59 -08:00
daanx	c4f1f2e079	make reclaim tries a percentage of the abandoned count	2024-03-01 14:57:46 -08:00
daanx	cf8f73098e	start abandoned search randomized	2024-03-01 10:51:18 -08:00
daanx	71bcf1c76b	maintain abandoned_count more robustly	2024-03-01 10:31:58 -08:00
daanx	1b3eb8ef28	quick exit from try_reclaim if no abandoned segments	2024-02-29 19:17:24 -08:00
daanx	931d523dcc	update mstress to let the main thread participate	2024-02-29 18:17:58 -08:00
daanx	64edbc92dd	allow abandoned segment reclaim on a free	2024-02-29 14:58:59 -08:00
daanx	bdda13b880	track abandoned segments in an arena bitmap instead of with a list	2024-02-29 14:27:28 -08:00
daanx	7020ed5e52	do not purge if purge delay is negative	2024-02-29 11:26:03 -08:00
daanx	632edf9996	rename was_zero/committed to initially_zero/committed	2023-04-24 09:03:43 -07:00