1183 commits

Author	SHA1	Message	Date
daan	a69016c33e	improve and document numa support	2019-11-02 10:30:16 -07:00
daan	2c12d7f223	optimized numa calls; better Linux support	2019-11-01 22:01:52 -07:00
daan	57dd69265a	normalize numa node	2019-11-01 20:30:01 -07:00
daan	2d10c78587	fix linux compilation	2019-11-01 20:19:00 -07:00
daan	3fadf4abaf	initial numa awareness for regions	2019-11-01 20:01:08 -07:00
daan	a6499be074	initial numa support for arenas	2019-11-01 19:53:07 -07:00
daan	aaf01620f4	improve allocation of the huge OS page arena	2019-10-31 19:39:49 -07:00
daan	d36d04b4a6	add arena for huge page management	2019-10-31 15:35:10 -07:00
daan	8725a88fba	fix assertion in debug secure mode	2019-10-30 15:22:40 -07:00
daan	4a4d74927c	protect against double-free in multi-threaded free list	2019-10-30 14:53:21 -07:00
daan	6cf16b1201	fix reset error on windows when disabling eager commit option	2019-10-30 14:32:28 -07:00
daan	b052d3b731	enable double free and heap corruption detection in debug mode	2019-10-28 15:54:33 -07:00
daan	87bdfbb9b6	use more conservative retire strategy	2019-10-28 14:12:06 -07:00
daan	081e2d1eb6	fix statistics display	2019-10-28 13:43:42 -07:00
daan	28d4ec4c5a	fix statistics accounting of huge pages	2019-10-28 13:14:14 -07:00
daan	5dfdc092b5	improve windows warning message	2019-10-28 12:26:57 -07:00
daan	25246070ae	fix double free check in secure = 4 mode; inline _mi_ptr_cookie	2019-10-19 08:34:18 -07:00
daan	2affdbbd2e	stronger secure mode when defining MI_SECURE=4: checks for double free, corrupted free list, and invalid pointer frees. Performance is impacted but not too much -- more perf testing is needed	2019-10-18 18:11:04 -07:00
daan	fdfa6ed260	fix warnings at high warning level in msvc	2019-10-17 16:56:57 -07:00
daan	5de851a84d	update page_flags to have more portable definition	2019-10-17 16:48:16 -07:00
daan	93b4281b82	ensure randomized huge page start address in 1GiB aligned	2019-10-17 12:35:35 -07:00
daan	454bc67338	increase delayed output buffer to 32k	2019-10-17 12:14:15 -07:00
daan	26c27fbf58	use uint8_t bit fields, and improve portability of page_flags type	2019-10-17 12:07:26 -07:00
Johannes Schindelin	0fd0122c0a	Avoid compiler warning when casting the result of GetProcAddress() ... It is most unfortunate that the return type of `GetProcAddress()` is `FARPROC` (which is essentially `intptr_t(*)(void)): this type cannot be cast by GCC without warnings to anything but the generic function pointer type `void(*)(void)`. Let's work around that. Signed-off-by: Johannes Schindelin <johannes.schindelin@gmx.de>	2019-10-17 20:43:18 +02:00
Johannes Schindelin	5bd8ea2e4f	Repeat mi_decl_allocator in functions' definitions ... Quite a few functions are declared with that attribute, and VS 2019 complains if the definition does not repeat it. Signed-off-by: Johannes Schindelin <johannes.schindelin@gmx.de>	2019-10-17 20:43:18 +02:00
daan	08d83cc33d	disallow regular allocation from the huge reserved area	2019-10-17 09:24:57 -07:00
daan	a96c90db5d	remove old windows overriding method	2019-10-17 09:22:23 -07:00
daan	480f7683a9	cleanup delayed output	2019-10-12 10:42:04 -07:00
Daan Leijen	5e9b37dc4e	add delayed output buffer	2019-10-12 10:21:42 -07:00
daan	1de6c22b49	remove incorrect region_count comment	2019-09-17 18:07:32 -07:00
daan	5744f90882	remove thread init/done verbose messages	2019-09-17 17:35:20 -07:00
daan	60efb62155	make secure a build option only	2019-09-17 17:31:42 -07:00
daan	d72b5350e3	fix error code on mprotect failure	2019-09-17 17:31:25 -07:00
daan	adf8e30eda	ensure large page privileges are acquired on windows when calling reserve_huge_os_pages	2019-09-14 15:23:28 -07:00
daan	24777f6a91	limit aligned allocation to power-of-two alignment	2019-09-11 17:49:28 -07:00
daan	050e7cedf4	roll back commit 0aec6d93 on alignment >= size as it breaks assertions in tensorflow	2019-09-11 15:48:44 -07:00
Daan Leijen	1909cfb346	refine mi_os_good_alloc_size and use it for huge pages (to ensure realloc is bounded as in #153	2019-09-10 13:26:51 -07:00
Daan Leijen	d278c26c0e	round huge page sizes into 12.5% increments (issue #153)	2019-09-10 07:54:31 -07:00
daan	ce81af1119	use mi_is_power_of_two when possible (pr #118)	2019-09-09 08:12:50 -07:00
daan	b104e434e4	fix volatile declaration on function	2019-09-09 08:07:35 -07:00
daan	23155c5d71	add recursion guard to deferred callback	2019-09-09 08:02:41 -07:00
daan	e227341f5b	fix mi_collect being called with empty heap (issue #150)	2019-09-09 07:54:36 -07:00
daan	7b63bc4211	add alignment check to aligned_alloc for C11 compliance	2019-09-07 12:02:22 -07:00
daan	0aec6d9302	don't align to sizes greater than than the allocation size	2019-09-07 12:01:54 -07:00
daan	b241910810	don't allocate more than PTRDIFF_MAX on aligned allocations	2019-09-07 11:52:21 -07:00
daan	f2f7c8d0e9	fix volatile declaration on function pointer	2019-09-07 09:18:29 -07:00
daan	89858ab791	improve page_free_extend performance slightly; do not maintain expensive statistics in release mode	2019-09-06 16:48:48 -07:00
daan	47fc73d694	fix c++ compilation; make default output non-atomic	2019-09-06 11:51:22 -07:00
daan	f38fcf79eb	ensure addresses of large aligned allocations are randomized	2019-09-06 09:19:26 -07:00
Jakub Szymanski	1a7b1783fa	changed strategy to reduce contention for region search and vs2019 project fix	2019-09-05 08:13:52 -07:00