Live data from Hacker News

RethinkDB: An open-source distributed database built with love over three years

rethinkdb.com

151–160 of 247 posts

Re: RethinkDB: An open-source distributed database built with love over three years

#151
post #55

Query language and ruby like function-chaining are what I feel the selling factors. I like the ease with which I added a node to the cluster. But naming the version as Rashomon scares me..

A release named Rashomon should be the one where they introduce versioning support, in my opinion.

Re: RethinkDB: An open-source distributed database built with love over three years

#152
Congratulate on releasing. Well done!

A few questions:

1. Will secondary indices be ever supported? Range scan with a different order than the primary key is very welcomed. E.g. date range query.

2. Do you support conditional update? Or any kind of optimistic locking or versioning to coordinate concurrent updates from different clients?

3. Related to 2. How can loosely-sequential Id be generated using a table?

4. Will some transaction support be added? Don't need full ACID, just grouping updates (intra-table and/or inter-tables) in one shot would be nice. Should be feasible with MVCC already in place.

5. Do all the clients hit a central server to initiate queries which then farms out the requests to different shards? Or the client library knows how to get to different shards directly? First case has a single-point-of-failure, and bottleneck in scaling.

6. Do you support automatically re-balancing of shard data (data migration) when new shards are added or old ones retired?

7. How are authentication and authorization done? Or any clients can come in?

8. Internal detail. For out-of-date distributed query on the slave replicas, is there a cost-based (or load-based) decision process to pick the most idle replica to do the sub-query?

9. Internal detail. Do you use Bloom Filter to optimize distributed joins?

Re: RethinkDB: An open-source distributed database built with love over three years

#153

Hey guys, Slava here. I've been up since yesterday, so I'm going to clock out (though some of the team members are still lurking here). I wanted to thank everyone for great feedback. We're working hard to improve Rethink over the next few months. FYI, you can always hop on IRC (#rethinkdb on freenode) or github tracker ( https://github.com/rethinkdb/rethinkdb/issues ) with questions and we'll help you out.

Thanks for this work, it looks really nice.

I was looking at the github comments about a home brew recipe in which it was stated that aside from a recipe creating a VM, the Mac OS X port would take a bit longer.

Is that a full port from one language to another? Or just an issue of the different flavors of *nix that need dealing with and probably some of the dependency tree issues that come with it?

I'm curious what needs be done to get it building on Mac OS X — perhaps I could assist somehow.

I see a few dependencies that don't immediately sound familiar. You may have better luck with MacPorts, which uses tcl as the language for their portfiles.

Portfiles are just like homebrews recipes, but MacPorts always builds new, including the entire dependency tree ( and dependencies of dependencies etc., etc. ), for which they have thousands of working portfiles. Since those are completed and working, you wouldn't have to worry about those until you wanted to be able to make a binary outside of any package manager.

MacPorts can build binaries now ( new feature ), so you could just as easily instruct it to create a standard Mac OS X installer .pkg which makes sure everything goes in the right place, on the right platform, for the right architecture.

They are an exceedingly friendly and helpful group, I'm sure they would live to see this software in their package/portfiles list.

Re: RethinkDB: An open-source distributed database built with love over three years

#154
post #152

Congratulate on releasing. Well done! A few questions: 1. Will secondary indices be ever supported? Range scan with a different order than the primary key is very welcomed. E.g. date range query. 2. Do you support conditional update? Or any kind of optimistic locking or versioning to coordinate concurrent updates from different clients? 3. Related to 2. How can loosely-sequential Id be generated using a table? 4. Wil…

Did they not launch a while ago: http://techcrunch.com/2011/06/06/rethinkdb-expands-beyond-ss... ?

Re: RethinkDB: An open-source distributed database built with love over three years

#155
post #152

Congratulate on releasing. Well done! A few questions: 1. Will secondary indices be ever supported? Range scan with a different order than the primary key is very welcomed. E.g. date range query. 2. Do you support conditional update? Or any kind of optimistic locking or versioning to coordinate concurrent updates from different clients? 3. Related to 2. How can loosely-sequential Id be generated using a table? 4. Wil…

Did they not launch a while ago: http://techcrunch.com/2011/06/06/rethinkdb-expands-beyond-ss... ?

Well any product release is a huge effort, especially database product. Things got done and pushed out of door. Congratulation well deserved.

Re: RethinkDB: An open-source distributed database built with love over three years

#157

Earlier quoted context omitted.

I have nothing to do with RethinkDB, but what are you talking about? Just represent them as strings. (What databases support colors as native types, anyways?) If you format dates YYYY-MM-DD, then you can do string comparisons for ranges. And JSON has the huge advantage of supporting hierarchical data -- arrays with objects inside, etc. It seems a like a huge step forward.

But there's no standard way of representing the dates as strings, or indicating that this field here is a date and not a string that happens to look like one, so nothing can rely on what you do. You can represent literally anything with a string, but you lose type information when you do.

Hopefully, your application knows that this field here is a date encoded in a string.

Re: RethinkDB: An open-source distributed database built with love over three years

#158
post #132

Thought I'll share this with you. A yc company hired me. I showed up at their mountain view office. The founder said "This is the former office of RethinkDB! I hope we are as successful as them." I didn't know who/what RethinkDB was, so I said ok, sure. 3 days later he asked me to clear my desk and leave. He said "You are the sort of person who should work in RethinkDB". So I asked "What does that mean ?" He said "Re…

I know lots of engineers who have trouble talking to people who don't share their knowledge. This problem is extremely pervasive - I'd say a good 25% or more have this problem to some extent. It's not a good thing when this happens - you need to be able to speak to laymen or you're gonna have a bad time. I am going to go out on a limb here and suggest you try to work on being a bit more practical. Don't complicate th…

I adjust the level of details and technical stuff pretty well according to who I am speaking to.

But sometimes someone with very limited knowledge of something asks me a detailed question about X.

What they ask is too difficult and complex to be described in a simple way. Either I have to overly simplify it which may insult them and will do no good or I have to go on and step by step give them digestible chunks of explanation which will inevitably be a bit technical even though I try to minimise that.

I think it's a two-way thing. The person should also consider their own level of knowledge before asking for an explanation of something and adjust their question based on that.

I don't ask my doctor to tell me why my heart does this and that because I simply don't have the knowledge to be able to understand his answer. I ask, my heart is doing ok? cool!

Re: RethinkDB: An open-source distributed database built with love over three years

#159
post #153

Hey guys, Slava here. I've been up since yesterday, so I'm going to clock out (though some of the team members are still lurking here). I wanted to thank everyone for great feedback. We're working hard to improve Rethink over the next few months. FYI, you can always hop on IRC (#rethinkdb on freenode) or github tracker ( https://github.com/rethinkdb/rethinkdb/issues ) with questions and we'll help you out.

Thanks for this work, it looks really nice. I was looking at the github comments about a home brew recipe in which it was stated that aside from a recipe creating a VM, the Mac OS X port would take a bit longer. Is that a full port from one language to another? Or just an issue of the different flavors of *nix that need dealing with and probably some of the dependency tree issues that come with it? I'm curious what n…

Seems to me that most of us who have used MacPorts have moved to Homebrew or that could just be the bubble I'm living in. Is there anyone still who still uses MacPorts who could chime in and say why they never made the switch?

Re: RethinkDB: An open-source distributed database built with love over three years

#160
post #158

Earlier quoted context omitted.

I know lots of engineers who have trouble talking to people who don't share their knowledge. This problem is extremely pervasive - I'd say a good 25% or more have this problem to some extent. It's not a good thing when this happens - you need to be able to speak to laymen or you're gonna have a bad time. I am going to go out on a limb here and suggest you try to work on being a bit more practical. Don't complicate th…

I adjust the level of details and technical stuff pretty well according to who I am speaking to. But sometimes someone with very limited knowledge of something asks me a detailed question about X. What they ask is too difficult and complex to be described in a simple way. Either I have to overly simplify it which may insult them and will do no good or I have to go on and step by step give them digestible chunks of ex…

I honestly I can't think of a single example where I was unable to determine the right level of explanation for someone. I think it's a unique skill that even non-engineers are often only superficially proficient at; though on that note, I do think that engineers aren't exposed enough to communication topics in University - most CS classes don't require group work, don't require verbal explanation of complex systems, etc. [1]

Reading, writing, and any sort of public speaking (especially debate if there's an opportunity) are TREMENDOUS for teaching you how to get into other peoples' heads, figure out how they're perceiving what you're saying, and adjusting what you're saying. I will sit in most of my CS classes and be PAINED when the class spends 10 minutes on a question because there is a disconnect between the misassumptions the student is making and the instructor thinks something else is the culprit.

These skills are also incredibly helpful in being charming and getting what you want without being manipulative.

[1]: Which is why some, like mine, created programs to blend CS and business to start to solve that problem. Students have to interact with paying customers, have to be accountable for their own code releases, are responsible for ALL of the requirement soliciting and fulfillment, etc.

Post reply on HN