The following library could be pluggable into our current framework: *STXXL implements containers and algorithms that can process huge volumes of data that only fit on disks.*: http://stxxl.sourceforge.net/