Consider using an arena allocator

[tkp1n]

Just a thought...
I could imagine an arena allocator doing quite well in this kind of use case.
@mgravell introduced a C# implementation here:
https://github.com/mgravell/Pipelines.Sockets.Unofficial/blob/master/docs/arenas.md