Hello, I was running some dynamic programming code (trying to brute-force disprove the Collatz conjecture =P) and I was using a dict to store the lengths of the chains I had already computed. Obviously, it ran out of memory at some point. Is there any easy way to use some variant of a dict which will page parts of itself out to disk whe...
I'm looking for a drop in solution for caching large-ish amounts of data. related questions but for different languages: Python Disk-Based Dictionary Disk-backed STL container classes? Close question in different terms: Looking for a simple standalone persistant dictionary implementation in C# I don't need (or want to pay anythi...
I stumbled across the WB on-disk B-tree library: http://people.csail.mit.edu/jaffer/WB It seems like it could be useful for my purposes (swapping data to disk during very large statistical calculations that do not fit in memory), but I was wondering how stable it is. Reading the manual, it seems worringly 'researchy' - there are sectio...
I need to store a big hash set, able to contain up to approx 200 millions 40 bit values. Storing it as 200 millions 64 bit value would be acceptable (despite the 200 millions * 16 bits loss). The requirements are: tiny memory footprint (disk space ain't an issue, memory is) fast contains(long l) and add(long l) methods (much faster t...