347 commits

Author	SHA1	Message	Date
Daan	38b5087cb9	merge from dev	2025-03-06 20:34:20 -08:00
Daan	9eac969ea5	improve atomic stat merging	2025-03-06 20:14:33 -08:00
Daan	907a59cd8e	Merge branch 'dev' into dev3	2025-03-06 19:52:39 -08:00
Daan	71c61c4b91	fix multi-threaded access in stats merging	2025-03-06 19:52:06 -08:00
daanx	d9580f3bfb	update popcnt to be more efficient on x64 even without MI_OPT_ARCH=ON	2025-03-06 18:54:04 -08:00
daanx	119f2eff6c	use int for numa node count	2025-03-05 09:51:40 -08:00
Daan Leijen	c18a5537dc	reduce medium page block size to 64k to reducemem usage	2025-03-03 20:50:21 -08:00
Daan	c1cbe71836	add numa-affine allocation, and per-heap numa affinity	2025-03-03 18:08:57 -08:00
Daan	30dfe97f5b	merge from dev	2025-03-03 16:28:43 -08:00
Daan	db831d4cf4	make mi_options_print, mi_arenas_print, and mi_stats_print independent of the vebosity setting	2025-03-03 16:23:28 -08:00
Daan Leijen	a447a1a297	merge from dev	2025-03-02 17:16:28 -08:00
Daan Leijen	58d13f6a4f	collect every N generic calls	2025-03-02 17:06:25 -08:00
Daan Leijen	6e0af52c95	merge new statistics from dev	2025-03-02 16:08:50 -08:00
Daan Leijen	09ad6d2819	initial statistics api	2025-03-02 15:34:37 -08:00
Daan Leijen	1b749ea7d8	clean up statistics	2025-03-01 20:51:44 -08:00
Daan Leijen	ec92690117	merge from dev; lean stats	2025-03-01 17:35:34 -08:00
Daan Leijen	56aba086ea	remove superfluous stat fields (count and freed)	2025-03-01 16:52:48 -08:00
Daan Leijen	bdaeb1d469	remove stat_adjust	2025-03-01 16:29:28 -08:00
daanx	6fce7b90a4	reduce object class sizes (/8), add max reclaim queue size	2025-02-28 16:51:59 -08:00
Daan Leijen	2efc71ef57	Merge branch 'dev3-bin' into dev3	2025-02-28 16:29:14 -08:00
Daan Leijen	c3fc75e0ff	update clz/ctz for BMI1	2025-02-28 16:26:45 -08:00
daanx	b59c1f8ce4	update comments	2025-02-24 13:48:21 -08:00
daanx	a7f11cd2b0	define mi_clz/ctz in portable way on x64 that does not require BMI1 (issue #1016)	2025-02-20 14:39:35 -08:00
Daan	f8857a5189	fix mi_bsr to not use lzcnt directly	2025-02-18 06:33:55 -08:00
Daan	6444cbc422	Merge branch 'dev3' into dev3-bin	2025-02-11 16:05:07 -08:00
daanx	d9439a7e39	merge from dev	2025-02-11 14:47:20 -08:00
daanx	ece1defe5b	parameter of clz/ctz is size_t	2025-02-11 14:35:21 -08:00
daanx	44a4c83fbf	maintain count in pagequeue for constant time test in free.c	2025-02-11 13:56:58 -08:00
daanx	e81ddcb786	Merge branch 'dev3' into dev3-bin	2025-02-11 13:07:20 -08:00
daanx	02b97b6891	merge from dev	2025-02-11 09:21:48 -08:00
daanx	ec4aa62b65	use physical memory in kib to avoid overflow of size_t (issue #1010)	2025-02-11 09:12:29 -08:00
Daan	e92358ba49	merge from dev; add _mi_heap_main_get ... (issue #1010)	2025-02-10 20:42:29 -08:00
Daan	35e81c1a3d	Merge branch 'dev3' into dev3-bin	2025-02-09 09:15:15 -08:00
Daan Leijen	d8c119cc4f	add mi_decl_maybe_unused; fix compilation with OPT_SIMD (issue #1009)	2025-02-09 08:56:22 -08:00
Daan	06ade47b05	fix is_huge definition	2025-02-08 23:26:45 -08:00
daanx	8d9b6b2b9e	merge from dev3	2025-02-08 13:14:19 -08:00
daanx	2048fa2d17	fix comments	2025-02-08 09:53:00 -08:00
daanx	7931678899	further optimize mi_bchunk_try_find_and_clearNX	2025-02-06 22:59:14 -08:00
Daan	63e625d9f8	Merge branch 'dev3' into dev3-bin	2025-02-06 11:56:33 -08:00
Daan	515047b676	improve free on macos	2025-02-05 20:55:21 -08:00
Daan	348a2b12f2	Merge branch 'dev3' into dev3-bin	2025-02-04 20:17:51 -08:00
Daan Leijen	8fc8da5d81	use thread local stats for abandoned statistics to reduce contention	2025-02-04 17:54:49 -08:00
Daan Leijen	db7930f961	avoid atomics in mi_free_try_collect_mt	2025-02-04 14:58:08 -08:00
Daan Leijen	59eeeadc34	only allow page_reclaim_on_free for small block pages	2025-02-04 12:26:21 -08:00
Daan	6f42cc3fae	Merge branch 'dev3' into dev3-bin	2025-01-31 10:38:04 -08:00
Daan	7703d14e8c	redefine abandoned mapped as a special thread id	2025-01-22 11:21:22 -08:00
Daan	1fcf0678cb	Merge branch 'dev3' into dev3-bin	2025-01-21 20:58:55 -08:00
Daan	5946e9cebf	fix assert	2025-01-21 20:58:45 -08:00
Daan	570b6b5a7a	slightly better bsf	2025-01-21 20:53:16 -08:00
Daan	92f182bf4f	Merge branch 'dev3' into dev3-bin	2025-01-21 20:38:14 -08:00