Small allocations are allocated using sbrk and never truly freed. Larger ones use mmap which gets freed.

Guess the solution would be either preallocating/reserving everything, or maybe using custom allocators that works with bigger chunks