Why the 'Ex-Googlers' in the title. Is it like a seal of approval or something?
Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
41–50 of 70 posts
Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#42Many things that I don't agree with: https://github.com/cockroachdb/cockroach/ MySQL: Weak consistency Cassandra: No availability or weak consistency with datacenter failure
Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#43Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#44Why the 'Ex-Googlers' in the title. Is it like a seal of approval or something?
Yes, it's called social proof. If you're observant you'll notice that people use it everywhere. Of course, social proof doesn't mean guarantees.
Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#45Are there distributed data stores like this that are also resilient to intentional sabotage? I've been looking recently at long-term digital preservation systems -- tools designed to archive large amounts of data for decades. This is the Library of Alexandria problem -- how do we preserve all this data we're generating against once-in-a-century disasters? So this 2005 paper lists thirteen different threats to long-te…
The core of the issue is that humans view different information differently (child porn vs. Mona Lisa), whereas for computers, bits are bits and numbers are numbers. As long as child porn remains illegal and socially unacceptable, we'll want to enable attacks on data, i.e. for someone (usually internal operators) to be able to delete some kind of information, corrupt it or at least track it. Of course, this necessarily means that all information stored in the same data-store will be vulnerable.
Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#46Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#47Earlier quoted context omitted.
It indicates that the project is worth a closer look rather than waiting or dismissing it outright.
Why? Being an ex-googler could just as easily imply they were incompetent and fired.
Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#48awful name!
Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#49Earlier quoted context omitted.
The design doc https://docs.google.com/document/d/11k2EmhLGSbViBvi6_zFEiKzu... says, "TBD: how to avoid partitions? Need to work out a simulation of the protocol to tune the behavior and see empirically how well it works" .. so they've gone for CA and forgotten about P.
You're taking a sentence out of context and giving it the most uncharitable possible interpretation. They certainly haven't "forgotten" about network partitions because if you actually read the design document, instead of ctrl-F'ing for the word "partition", they talk about the mechanisms they use to ensure sequential consistency. The software is not yet at the point of being testable AFAIK, but clearly the intent is…
From the intro page:
"Cockroach is a distributed key/value datastore which supports ACID transactional semantics and versioned values as first-class features. The primary design goal is global consistency and survivability, hence the name. Cockroach aims to tolerate disk, machine, rack, and even datacenter failures with minimal latency disruption and no manual intervention."
If we read 'survivability' as 'availability', then that would suggest they've gone for CA. Although closer inspection reveals that their architecture seems to be made of shards each of which is maintained with Raft/Paxos. An evaluation of this by the Cambridge Computer laboratory is here: http://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-857.pdf
That report makes two points relevant to this discussion. One is that a hard definition of C A and P can be difficult and that it's possible to achieve all three almost all of the time in real conditions. The other is from the conclusion:
"In particular, a [Raft] cluster can be rendered useless by a frequently disconnected node or a node with an asymmetric partition"
Re: Ex-Googlers CockroachDB: A Scalable, Geo-Replicated, Transactional Datastore
#50Many things that I don't agree with: https://github.com/cockroachdb/cockroach/ MySQL: Weak consistency Cassandra: No availability or weak consistency with datacenter failure