I found out foundationDB vienna VA office is closed.
Did apple move all people to Cupertino?
Apple open-sources FoundationDB
81–90 of 453 posts
Re: Apple open-sources FoundationDB
#82I hate to be that person, but when I hear "ACID transactions in a distributed database", I hear Citus/Spanner/CockroachDB. I'm positive that Citus & Spanner are quite different from FoundationDB, but I have no idea how. Googling didn't help much. Can someone provide an overview of the differences?
Spanner is geographically distributed and synchronizes over Google’s fiber. I’m not sure where FoundationDB falls on the spectrum, but there is “distributed” meaning runs on multiple machines, vs multiple availability zones (which could be in the same rough geographic area to minimize latency), vs multiple geographic regions, which is one of Google’s design goals for its distributed infrastructure nowadays: to be able to withstand a natural disaster or other disruption that takes a whole region offline, without missing a beat.
There’s still a lot to be said for the property, “scales horizontally to N machines,” of course, even if those machines have to be in the same data center.
Re: Apple open-sources FoundationDB
#83I went to the same high school as the founders[1]. They were about the 2 best software engineers in a school with a LOT of very smart software engineers. Another pair founded Yext, which went public last year. I still consider that school the group with the highest concentration of raw brain power I've ever been a part of. I'm probably a 1% engineer, been hired by M$, FB, and Google. These guys were light years ahead…
That's a great school. I hired some students there when I ran a tech camp for middle-schoolers and they were...beyond.
Re: Apple open-sources FoundationDB
#84Earlier quoted context omitted.
My understanding of hbase (which could be wrong) is that writes of a particular key always go to the region master first, so if you read from the master you always get the latest value of a key. The tricky part is that when the region master goes offline another one needs to take its place, and you can get inconsistency or unavailability depending on how it is set up. I’d like to see a deep dive of how foundationdb h…
From what I understand that shouldn't happen as writes are written to a WAL on HDFS (been a while since I've used it). From my memory writes within a row are atomic. It seems to pass Jepsen as well [1]. 1. https://www.google.co.uk/amp/s/yokota.blog/2015/09/30/call-m...
[deleted]
Re: Apple open-sources FoundationDB
#85Originally, FDB was a DB supporting 3 models: - KV - Document - Graph It seems the announcement concerns only the KV one. Someone has information for the 2 other ones? Thank you.
The core product is a distributed, highly fault tolerant ordered Key Value store with true serializable ACID transactions. All of the layers (including document, graph) sit on top of that and inherit its ACID properties, scalability, fault tolerance, etc. It doesn't appear to me that they released any of the top level layers, but those are MUCH simpler to build, and that's where the OS community can step in.
Re: Apple open-sources FoundationDB
#86Originally, FDB was a DB supporting 3 models: - KV - Document - Graph It seems the announcement concerns only the KV one. Someone has information for the 2 other ones? Thank you.
The core product is a distributed, highly fault tolerant ordered Key Value store with true serializable ACID transactions. All of the layers (including document, graph) sit on top of that and inherit its ACID properties, scalability, fault tolerance, etc. It doesn't appear to me that they released any of the top level layers, but those are MUCH simpler to build, and that's where the OS community can step in.
How is FoundationDB's graph performance/feature set compared to those of other graph and multi-model databases?
Re: Apple open-sources FoundationDB
#87Firstly: Wow! this is amazing news!!!
I'm also kind of confused.. is the single repo complete?
What about the SQL Layer [0]? Where is all this stuff in the new GH repo?
Or is only the KV part be open-source?
Looking forward to some CockroachDB vs. FDB benchmark showdowns :)
Re: Apple open-sources FoundationDB
#88How does this stack up against HBase and Cassandra, which seem to have gotten traction already in the same areas that FoundationDB seems best suited for?
HBase and Cassandra both provide much weaker guarantees. At best they can support compare-and-set operations that are local to a single region/"row", whereas FoundationDB lets you do optimistic transactions (and consistent read snapshots) on the entire database. And at least in cassandra even getting that level of consistency comes at a big performance cost.
The benefit of ACID transactions isn't just safety at the application level, it's the ability to compose abstractions and build complex data models on top of simple ones. For example, indexes in FoundationDB are typically more scalable than in the majority of other systems, where index queries often have to be broadcast to all the systems in a cluster. Yet FoundationDB doesn't even have indexes as a feature - higher layers build and maintain index invariants using transactions.
FoundationDB is also just really reliable and fault tolerant. Its testing story is drastically better than what the teams building these other products are doing.
Re: Apple open-sources FoundationDB
#89Noticed the Visual Studio project files. Was Windows a primary development platform for foundationdb?
Re: Apple open-sources FoundationDB
#90These days most people know Hadoop for a distributed storage. In my opinion, though CEPH [1] has the bigger potential.