Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cdb: a fast, reliable, simple package for creating, reading constant databases

cr.yp.to

Post reply on HN
Print view View original

11–20 of 43 posts

Re: Cdb: a fast, reliable, simple package for creating, reading constant databases

#12

Post by krenoten »

CDB is awesome for its use case - slow changing, read-heavy workflows that are tolerant of stale data. One limitation of the original implementation is the use of 32-bit keys for addressing, which limit the addressable size to 4gb. There are 64 bit modifications, but I have not used them. Does anyone have an opinion on any of the 64-bit implementations?

Re: Cdb: a fast, reliable, simple package for creating, reading constant databases

#13

Post by krenoten »

spydum wrote: post #6
ludamad wrote: post #2

What advantages does this have over SQLite?

i think the appropriate comparison would be bdb, not SQLite. and from the site, I can't tell?

cdb is immutable - when you want to change the contained data set you generally rebuild the file, flip a fs link to the new version, and release file descriptors referencing the old version in applications when it's time to move on. bdb updates in place, but is slower for reads.

Re: Cdb: a fast, reliable, simple package for creating, reading constant databases

#14

Post by visarga »

I'd like to see a more up-to date CDB with the 4Gb limit removed. Writing could be implemented by using additional smaller CDB or text file. It would be an interesting problem to find at what size a flat text file should be converted into CDB to maximize speed on the whole.

Re: Cdb: a fast, reliable, simple package for creating, reading constant databases

#15

Post by dsl »

cordite wrote: post #10

That's cool. But I feel like I'll totally forget about it and lose reference to this (in case I have future interest). Where's a github mirror? A google search reveals some entries from the language implementations. Go: https://github.com/jbarham/go-cdb Java: https://github.com/malyn/sg-cdb Haskell: https://github.com/adamsmasher/hs-cdb

Most open source development takes place outside of github. It is a very valley-centric thing.

You'll find a ton of life changing stuff on SourceForge and random FTP sites.

Re: Cdb: a fast, reliable, simple package for creating, reading constant databases

#17

Post by keeganpoppen »

dsl wrote: post #15
cordite wrote: post #10

That's cool. But I feel like I'll totally forget about it and lose reference to this (in case I have future interest). Where's a github mirror? A google search reveals some entries from the language implementations. Go: https://github.com/jbarham/go-cdb Java: https://github.com/malyn/sg-cdb Haskell: https://github.com/adamsmasher/hs-cdb

Most open source development takes place outside of github. It is a very valley-centric thing. You'll find a ton of life changing stuff on SourceForge and random FTP sites.

to be fair, i assume he's only asking because github starring something is actual a fairly good way of keeping track of projects in the way he's talking about. i agree that it sounds a bit presumptuous to say "where's the github mirror, mr. unpaid contributor to open source project", but on the flip side it's a fair point in terms of potentially capitalizing on exposure for a project. and also it's very true that you can sometimes find the best code in very unassuming places.
Post reply on HN