All that to say, that particular comparison feels a bit Apples and Oranges to me.
Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
21–30 of 77 posts
Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#22I feel like between Redis, S3, Cloud Storage, RocksDB, Cassandra, etc...this area strikes me as one that has been solved as well as we could reasonably expect it to be. What the world of data needs more of is continued development into novel indexing strategies/implementations. ElasticSearch, Postgres's GIN index on JSONB, MapReduce, graph databases. I don't need another key value store...
Cassandra is JVM GC issues Redis is in-memory only Cloud Storage - Not sure, how we can use it outside of cloud vendors RocksDB - Facebook just outsourced the engine to the community, where is the service which adds replication, clustering and network interface on top of it? I am sure, they use one internally, why is it not being open-sourced? There is also badger but most of these only offer low-level operation. Sor…
Actually I would prefer such kind of database (just the engine).
1. Expose it to network via what ever framework you like. Thrift, Rest, grpc, ... You don't have to include different kind of libraries for each network service. I would love to connect to every network service (Redis, Elasticsearch, Cassandra, MySQL, ...) via a single framework (say grpc).
2. In most large scale scenarios, there is already some kind of log service (DistributedLog, NATS, Kafka, ...). Why not take benefit of that for replication? Isn't it great to separate the engine layer from replication layer? Currently we are doing double replication actually. Replicate data from master DB to slave DB. Then replicate the same data, from any DB to cache, search, ... components. The data is already there on log. Let everyone (slave DB as well as cache/search module) consume it. This is basically state machine replication idiom. PNUTS[0], Twitter K/V database, LinkedIn Espresso [1] (as well as Ambry[2] which is their internal object store), ... use this approach for replication.
3. I would agree with that, they only support basic low level operations.
[0] http://www.vldb.org/pvldb/1/1454167.pdf
Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#23I feel like between Redis, S3, Cloud Storage, RocksDB, Cassandra, etc...this area strikes me as one that has been solved as well as we could reasonably expect it to be. What the world of data needs more of is continued development into novel indexing strategies/implementations. ElasticSearch, Postgres's GIN index on JSONB, MapReduce, graph databases. I don't need another key value store...
Cassandra is JVM GC issues Redis is in-memory only Cloud Storage - Not sure, how we can use it outside of cloud vendors RocksDB - Facebook just outsourced the engine to the community, where is the service which adds replication, clustering and network interface on top of it? I am sure, they use one internally, why is it not being open-sourced? There is also badger but most of these only offer low-level operation. Sor…
Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#24So... is that kind of like Riak where (I believe Riak would do this) would send all conflicting values to the client for resolution, but instead you provide resolution strategies as part of the query? My understanding of vector clocks is admittedly pretty shitty though.
Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#25Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#26Why so much focus on Key Value stores? That's the easy part of the problem.
I would like to know more about the interesting ones: secondary indexes, range scans, performance on mixed workloads, robustness, operational complexity.
Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#27Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#28> it was up to 700x faster than Masstree, up to 800x Intel’s “lock-free” TBB hash table. In fairness, those systems provide linearizable consistency and Anna does not. But Anna was still up to 126x faster than a “hogwild”-style completely inconsistent C++ hashtable due to cache locality for private state, while providing quite attractive coordination-free consistency.
Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#29Can Anna's approach improve current solutions to the problem of managing secondary indexes in a partitioned KV store while preserving consistency?
Re: Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
#30Rant: Why so much focus on Key Value stores? That's the easy part of the problem. I would like to know more about the interesting ones: secondary indexes, range scans, performance on mixed workloads, robustness, operational complexity.