Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple open-sources FoundationDB

foundationdb.org

Post reply on HN
Print view View original

351–360 of 453 posts

Re: Apple open-sources FoundationDB

#351

Post by diaz »

skissane wrote: post #327
julien_c wrote: post #63

Earlier quoted context omitted.

Honest question, does MongoDB not work for this?

MongoDB is AGPL or proprietary. Many companies have a policy against using AGPL licensed code. So, if you work at one of those companies, then open source MongoDB is not an option (at least for work projects), and proprietary may not be either (depending on budget etc). FoundationDB is now licensed under Apache 2, which is a much more permissive license, so most companies' open source policies allow it.

Unless people want to change the mongodb code that they would be using, using the agpl software should be a non issue and there are not problems with it. People should start understanding the available licenses instead of spreading fear.

Re: Apple open-sources FoundationDB

#353

Post by qaq »

koide wrote: post #302
qaq wrote: post #201

Earlier quoted context omitted.

"but we have lost machines, connectivity, seen kernel panics, EBS failures, SSD failures, etc., your usual day in AWS " <=== This I wish more people realized that is a day to day reality if you are in AWS at scale.

As I understand it, it's like that everywhere at scale, not just on AWS, it being a property of operating at scale. Or are you saying that AWS is particularly unreliable at scale?

On the network side no, it's much more crappy on AWS.

Re: Apple open-sources FoundationDB

#356

Post by koide »

qaq wrote: post #353
koide wrote: post #302

Earlier quoted context omitted.

As I understand it, it's like that everywhere at scale, not just on AWS, it being a property of operating at scale. Or are you saying that AWS is particularly unreliable at scale?

On the network side no, it's much more crappy on AWS.

Which provider is the best, network wise?

Re: Apple open-sources FoundationDB

#357

Post by burntsushi »

fizx wrote: post #211
voidmain wrote: post #194

Earlier quoted context omitted.

It's more like you would build a better Elasticsearch using Lucene to do the indexing and FoundationDB to do the storage. FoundationDB will make it fault tolerant and scalable; the other pieces will be stateless.

It'd take a low number of hours to wire up FoundationDB as a Lucene filesystem (Directory) implementation. Shared filesystem with a local RAM cache has been practical for a while in Lucene, and was briefly supported then deprecated in Elasticsearch. I've used Lucene on top of HDFS and S3 quite nicely. If you have a reason to use FoundationDB over HDFS, NFS, S3, etc, then this will work well. Doing a Lucene+DB impleme…

> I've used Lucene on top of HDFS and S3 quite nicely.

Out of curiosity, what led you to do this? And what does it do better/worse/differently than out-of-the-box things like Elasticsearch or SOLR?

Re: Apple open-sources FoundationDB

#358

Post by voidmain »

polskibus wrote: post #328
voidmain wrote: post #273

Earlier quoted context omitted.

In addition to single-key asynchronous watches, there are also versionstamped ops (for maintaining your own, sophisticated log in a layer) and configurable key range transaction logging (but see the caveats in my other post on the topic). I'm not sure it has every feature it will ever need in this area, but it's a pretty good starting point for building "reactive" stuff.

Does the trigger execute in scope of triggering transaction with the same isolation level?

Versionstamped operations and transaction logging are fully transactional. Watches are asynchronous: they are used to optimize a polling loop that would "work" without them.

Re: Apple open-sources FoundationDB

#360

Post by jacobparker »

lars_francke wrote: post #308
wwilson wrote: post #2

This is INCREDIBLE news! FoundationDB is the greatest piece of software I’ve ever worked on or used, and an amazing primitive for anybody who’s building distributed systems. The short version is that FDB is a massively scalable and fast transactional distributed database with some of the best testing and fault-tolerance on earth[1]. It’s in widespread production use at Apple and several other major companies. But the…

> How about replacing your Lucene/ElasticSearch index with something that actually scales and works? Do you have something to back that up? This to me reads like you imply that Elasticsearch does not work and scale. It's definitely interesting but I'm cautious. The track record for FoundationDB and Apple has not been great here. IIRC they acquired the company and took the software offline leaving people in the rain?…

> Do you have something to back that up? This to me reads like you imply that Elasticsearch does not work and scale.

https://www.elastic.co/guide/en/elasticsearch/resiliency/cur...

https://aphyr.com/posts/317-call-me-maybe-elasticsearch

https://aphyr.com/posts/323-call-me-maybe-elasticsearch-1-5-...

The statement was blunt but the reputation is not exactly unearned. These problems become worse proportional to scale.

Post reply on HN