181 commits

Author	SHA1	Message	Date
daanx	d15e83030e	wip: rename arena blocks to slices	2024-11-30 12:16:41 -08:00
daanx	188294a0df	wip: bug fixes	2024-11-30 11:12:39 -08:00
daanx	9d904e8643	wip: bug fixes	2024-11-30 10:39:30 -08:00
daanx	0f635413d6	wip: can run initial test	2024-11-29 17:50:37 -08:00
daanx	9603fe8b50	can compile without missing functions	2024-11-29 16:27:58 -08:00
daanx	68f5fb2f4b	wip: further progress on segment removal; arena allocation	2024-11-29 15:08:06 -08:00
daanx	46afcbe06c	wip: further progress on segment removal; arena allocation	2024-11-29 14:28:34 -08:00
daanx	441d4fed9f	wip: further progress on removing segments	2024-11-29 10:40:18 -08:00
daanx	71cfa45e76	wip: initial work on mimalloc3 without segments	2024-11-28 19:31:04 -08:00
Daan	9b7537755a	Merge branch 'dev-steal' into dev	2024-11-25 19:28:35 -08:00
Daan	cd61eb7cf1	Merge pull request #961 from devnexen/windows_tighten_criterias ... _mi_memcpy/_mi_memzero: tighten criteria for intrinsics for windows.	2024-11-25 19:25:26 -08:00
daanx	71fec8caf5	add target_segments_per_thread option	2024-11-18 15:05:22 -08:00
daanx	d57cb0765d	add guarded objects that are sampled (and fit a size range). guarded sample rate etc can be set per heap as well as defaulted with options	2024-11-17 22:45:09 -08:00
daanx	8ba1879073	add sampling for guarded objects	2024-11-17 00:06:16 -08:00
daanx	8b6017d976	rename mi_debug_guarded_ to mi_guarded_	2024-11-16 22:42:32 -08:00
daanx	498c92e348	update guarded implementation to use block tags	2024-11-16 21:15:50 -08:00
David Carlier	9f0a7ac0be	_mi_memcpy/_mi_memzero: tighten criteria for intrinsics for windows. ... FSRM is better used for buffer <= 128 bytes and ERMS, if supported for larger chunks.	2024-11-16 10:05:14 +00:00
Daan	5f35933331	add 0 byte to canary to prevent spurious read overflow to read the canary (issue #951, pr #953)	2024-10-27 21:39:07 -07:00
Daan	aa881733d7	reorganize primitives for process initialization; use special data segment on Windows for thread termination by default on Windows now (issue #869)	2024-10-21 22:56:59 -07:00
Daan Leijen	4234a9bd9d	Merge branch 'dev-guarded' into dev	2024-08-21 11:30:33 -07:00
Daan Leijen	b9b529de28	shuffle for 128 bit	2024-08-21 10:45:19 -07:00
daanx	0c19eb60cf	initial working guarded pages	2024-08-19 21:21:40 -07:00
Daan	7b5df14bea	initial work on guarded objects	2024-07-16 09:15:59 -07:00
QuarticCat	632421da3a	fix typos	2024-06-19 10:49:03 +08:00
daanx	96b69d7ef6	fix leak where OS abandoned blocks were not always reclaimed	2024-06-03 17:28:14 -07:00
Daan	7e23576efa	remove old mi_abandoned_await_readers	2024-06-03 09:57:03 -07:00
daanx	5501f59f6c	only reclaim for exclusive heaps in their associated arena	2024-06-02 13:16:20 -07:00
daanx	8f874555d5	add initial support for visiting abandoned segments per subprocess, upstream for python/cpython#114133	2024-06-02 07:47:08 -07:00
Daan Leijen	0b3cd51249	add initial primitive api for locks	2024-06-01 16:45:20 -07:00
daanx	d9aa19a763	add support for sub-processes (to supportpython/cpython#113717)	2024-06-01 15:57:18 -07:00
daanx	616db104a9	prevent UB in arena reservation	2024-06-01 12:29:48 -07:00
Daan	0c4041fa53	add support for custom heap and page tags, upstream of python/cpython#113742	2024-05-19 08:06:32 -07:00
Daan	710d6138c7	refactor thread meta-data initilazation, upstream of python/cpython#113263	2024-05-18 17:42:47 -07:00
daanx	381da05d8a	make mimalloc includes relative to the current file, upstream of python/cpython#113141	2024-05-18 16:48:58 -07:00
daanx	1b21415dfa	make retry on oom an option; revise size options to not overflow the long	2024-05-18 09:56:02 -07:00
Daan	7128db7bba	simplified aligned allocation; improved codegen; fix mi_good_size with padding included; add MI_MAX_ALIGN_GUARANTEE	2024-05-11 06:43:52 -07:00
Daan	bf5932c3c6	use better purging for segments_collect	2024-04-19 12:43:05 -07:00
Daan	2b7530e183	add segment_collect for forced heap_collect	2024-04-19 12:33:17 -07:00
Daan	32e065bb32	rename segment_thread_collect to segment_collect	2024-04-19 12:11:58 -07:00
Daan Leijen	0022802177	commend and make at least 8 tries for reclaim	2024-03-25 15:25:04 -07:00
daanx	006ae2d055	add is_huge page flag to ensure the right page queue is returned (see #868)	2024-03-24 17:07:28 -07:00
Daan Leijen	a8a53e3e85	fix double counting of free-ing for non-thread-local free calls	2024-03-24 14:50:15 -07:00
Daan Leijen	b5665f0eec	add full block_size and page_start to page info	2024-03-24 14:17:17 -07:00
Daan Leijen	07ae64bd81	faster check for NULL in mi_free by combining with masking	2024-03-24 10:39:22 -07:00
Daan Leijen	60c4a0fe56	fix compilation warnings for new uint16_t size for used field	2024-03-24 08:10:35 -07:00
Daan	cc809b0cd4	take 16 bits from used field to create a fast unalign path	2024-03-18 01:40:03 -07:00
daanx	70e3ce07d1	Merge branch 'dev' into dev-abandon	2024-03-02 17:34:58 -08:00
Daan	683332c950	Define reallocarr as weak to avoid symbol collision on gnu/Linux. #751 by @Romain-Geissler-1A	2024-03-02 17:12:58 -08:00
Daan	e1f6516fda	Fix undefined symbol errors when building for wasi #758, by @anuraaga	2024-03-02 17:05:29 -08:00
daanx	500d2ad1fd	ensure non-arena segments are force purged on abandonment; make non-arena reclaim atomic	2024-03-01 18:47:59 -08:00