214 commits

Author	SHA1	Message	Date
daanx	8899a11c70	clean up guarded pages code	2024-08-20 11:09:17 -07:00
daanx	635cf7af6a	fix multi-threaded free to unprotect guarded blocks	2024-08-20 09:55:57 -07:00
daanx	0c19eb60cf	initial working guarded pages	2024-08-19 21:21:40 -07:00
Daan	7b5df14bea	initial work on guarded objects	2024-07-16 09:15:59 -07:00
daanx	b1188ea336	fix potential race on subproc field in the segment	2024-06-03 20:57:00 -07:00
daanx	96b69d7ef6	fix leak where OS abandoned blocks were not always reclaimed	2024-06-03 17:28:14 -07:00
daanx	3333f776f9	push os abandoned blocks at the tail end	2024-06-03 15:37:05 -07:00
Daan	7e23576efa	remove old mi_abandoned_await_readers	2024-06-03 09:57:03 -07:00
Daan	6b15342709	fix pthread initalization of mutexes	2024-06-02 16:41:07 -07:00
daanx	5501f59f6c	only reclaim for exclusive heaps in their associated arena	2024-06-02 13:16:20 -07:00
daanx	855e3b2549	add support to visit _all_ abandoned segment blocks per sub-process, upstream for python/cpython#114133	2024-06-02 09:41:12 -07:00
daanx	8f874555d5	add initial support for visiting abandoned segments per subprocess, upstream for python/cpython#114133	2024-06-02 07:47:08 -07:00
Daan Leijen	f93fb900b7	move lock code to atomic.h	2024-06-01 17:25:45 -07:00
Daan Leijen	0b3cd51249	add initial primitive api for locks	2024-06-01 16:45:20 -07:00
daanx	d9aa19a763	add support for sub-processes (to supportpython/cpython#113717)	2024-06-01 15:57:18 -07:00
daanx	616db104a9	prevent UB in arena reservation	2024-06-01 12:29:48 -07:00
daanx	b9b321d328	use _builtin_thread_pointer also on gcc 11-x64 and clang-14-x64	2024-05-19 20:42:28 -07:00
Daan	0c4041fa53	add support for custom heap and page tags, upstream of python/cpython#113742	2024-05-19 08:06:32 -07:00
Daan	710d6138c7	refactor thread meta-data initilazation, upstream of python/cpython#113263	2024-05-18 17:42:47 -07:00
Daan	66052f135f	allow custom thread id, upstream of python/cpython#115488)	2024-05-18 17:05:13 -07:00
daanx	381da05d8a	make mimalloc includes relative to the current file, upstream of python/cpython#113141	2024-05-18 16:48:58 -07:00
daanx	c48a21215b	fix arm64 windows compilation, upstream of python/cpython#111527	2024-05-18 16:41:39 -07:00
daanx	937fd19338	comment	2024-05-18 16:32:10 -07:00
daanx	1b21415dfa	make retry on oom an option; revise size options to not overflow the long	2024-05-18 09:56:02 -07:00
Daan	a38c8dd0f9	rename must_free_whole -> has_partial_free	2024-05-16 14:41:10 -07:00
Daan	13e519202a	fix comments; nicer strdup/strndup	2024-05-13 09:02:40 -07:00
Daan	b1ec1d5e5a	refactor aligned allocation	2024-05-11 07:22:56 -07:00
Daan	7128db7bba	simplified aligned allocation; improved codegen; fix mi_good_size with padding included; add MI_MAX_ALIGN_GUARANTEE	2024-05-11 06:43:52 -07:00
Daan	1ebc28a8ff	update comment	2024-05-10 15:58:37 -07:00
Daan	cc3c14f2ed	use builtin_thread_pointer only on non-apple arm64 (issue #883 and #851)	2024-04-26 23:34:10 -07:00
Daan	146f9d2333	make TLS slot default instead of __builtin_thread_pointer. Potentially fixes build errors on various platforms (see issue #883)	2024-04-24 19:48:04 -07:00
Daan	204348e468	only define WIN32_LEAN_AND_MEAN if needed	2024-04-20 16:58:58 -07:00
Daan	7247b9e326	allow configuring page and segment sizes (pr #753 and pr #862)	2024-04-20 16:45:49 -07:00
Daan	336f83fbd1	use __builtin_thread_pointer on arm64 with older gcc compilers (issue #851)	2024-04-20 16:09:45 -07:00
Daan	bf5932c3c6	use better purging for segments_collect	2024-04-19 12:43:05 -07:00
Daan	2b7530e183	add segment_collect for forced heap_collect	2024-04-19 12:33:17 -07:00
Daan	32e065bb32	rename segment_thread_collect to segment_collect	2024-04-19 12:11:58 -07:00
Daan	5050b63038	define MI_MAX_ALLOC_SIZE as PTRDIFF_MAX (related to #877)	2024-04-19 09:53:21 -07:00
Daan Leijen	0022802177	commend and make at least 8 tries for reclaim	2024-03-25 15:25:04 -07:00
daanx	006ae2d055	add is_huge page flag to ensure the right page queue is returned (see #868)	2024-03-24 17:07:28 -07:00
Daan Leijen	a8a53e3e85	fix double counting of free-ing for non-thread-local free calls	2024-03-24 14:50:15 -07:00
Daan Leijen	b5665f0eec	add full block_size and page_start to page info	2024-03-24 14:17:17 -07:00
Daan Leijen	6688b45fbd	rename MI_ALIGNMENT_MAX to MI_BLOCK_ALIGNMENT_MAX for clarity	2024-03-24 10:57:02 -07:00
Daan Leijen	07ae64bd81	faster check for NULL in mi_free by combining with masking	2024-03-24 10:39:22 -07:00
Daan Leijen	ea6137a501	use MI_MAX_ALIGN_SIZE to adjust block_offset_adj	2024-03-24 09:01:58 -07:00
Daan Leijen	60c4a0fe56	fix compilation warnings for new uint16_t size for used field	2024-03-24 08:10:35 -07:00
Daan	9085596eab	update comment	2024-03-23 08:57:29 -07:00
Daan	cc809b0cd4	take 16 bits from used field to create a fast unalign path	2024-03-18 01:40:03 -07:00
Daan	db52999d85	update used block comment (issue #861)	2024-03-08 09:01:26 -08:00
daanx	5fe83bf327	limit reclaim from free to half the segments to prevent a pure freeing thread to reclaim too many segments	2024-03-03 17:38:50 -08:00