I have been looking for a free C library that supports common data structures (queues, trees, hashes etc.) and algorithms (sort, bulk search etc.) in external memory backed by regular files. One piece of software that I have been able to find as being closest to what I want was
stxxl, a C+++ STL for extra large data sets. Please let me know if you happened to stumble upon something on these lines.
PS: I filed an
RFP for libstxxl and I am willing to sponsor uploads in case somebody is interested in packaging and maintaining it.