Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ArangoDB 3.0 Release – A Solid Ground to Scale

arangodb.com

Post reply on HN
Print view View original

31–40 of 43 posts

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#31

Post by Diederich »

bryanlarsen wrote: post #29
Diederich wrote: post #28

Earlier quoted context omitted.

Ok, I think that makes sense. So, to restate, that means that RocksDB (or whatever) might have Facebook patented code/material in it, and Facebook is granting a very generous grant to use those patents. ...until a given organization comes into patent conflict with any of Facebook's patents, at which time their grants disappear. So if I'm understanding that correctly, doesn't that basically mean the same thing? You're…

"until a given organization comes into patent conflict with any of Facebook's patents" Note that the grants only disappear if you initiate the conflict; they don't disappear if Facebook initiates and you counter-sue.

Ok, so that's a useful clarification.

My problem is that I'm working for a subsidiary of a really big company that is directly competing with some parts of Facebook. There's a non-zero chance that some part of my company, far far away from me, will initiate an action that triggers this clause some time in the future.

In short: my company's ability to use a growing set of otherwise high-quality projects is greatly impacted because of this legal language. I also strongly suspect this isn't limited to just my organization.

One way or another, thank you for your attention.

I would love to hear from any other members of large organizations about this matter. Granted, my view is pretty limited, but this doesn't strike me as a good way forward for the overall free software community.

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#32

Post by continuational »

fceller wrote: post #26
continuational wrote: post #25

Can I change the number of shards on an existing collection without taking it offline?

Hi, I'm Frank from ArangoDB. You should create a number of shards that is much higher than your initial number of servers. ArangoDB can cope with multiple shards per server. This way, you can easily redistribute shards when adding new servers.

Thank you for the answer. I'm currently dealing with an inflow of about one million documents a day; it's an ever growing collection (grows by a few TB each year). Should I just configure it with 1000 shards? Or would it perform bettet with fewer shards?

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#33

Post by fceller »

continuational wrote: post #32
fceller wrote: post #26

Earlier quoted context omitted.

Hi, I'm Frank from ArangoDB. You should create a number of shards that is much higher than your initial number of servers. ArangoDB can cope with multiple shards per server. This way, you can easily redistribute shards when adding new servers.

Thank you for the answer. I'm currently dealing with an inflow of about one million documents a day; it's an ever growing collection (grows by a few TB each year). Should I just configure it with 1000 shards? Or would it perform bettet with fewer shards?

yes, using 1000 shards would work. Eventually, we will also support splitting shards.

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#34

Post by bryanlarsen »

Diederich wrote: post #31
bryanlarsen wrote: post #29

Earlier quoted context omitted.

"until a given organization comes into patent conflict with any of Facebook's patents" Note that the grants only disappear if you initiate the conflict; they don't disappear if Facebook initiates and you counter-sue.

Ok, so that's a useful clarification. My problem is that I'm working for a subsidiary of a really big company that is directly competing with some parts of Facebook. There's a non-zero chance that some part of my company, far far away from me, will initiate an action that triggers this clause some time in the future. In short: my company's ability to use a growing set of otherwise high-quality projects is greatly imp…

AFAICT, Apple finds this patent grant acceptable, whereas previous versions were unacceptable. Apple is well known for suing competitors for patent infringement, so they obviously feel that the loss of this patent grant would be acceptable, that the devolution to pure BSD is enough protection.

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#35

Post by don71 »

buckbova wrote: post #30
pluma wrote: post #9

Earlier quoted context omitted.

Not to blow my own trumpet but I think the new Foxx API (for letting you write your own HTTP endpoints in JS) is a huge step forward, too ;) (I'm the lead developer of the new ArangoDB Foxx, AMA)

Is the Foxx API supposed to imitate what would be stored procedures on the traditional rdbms?

Hi! I'm Claudius from ArangoDB.

Saying Foxx is like stored procedures is overly simplistic.

ArangoDB's external API is the HTTP API. Foxx lets you extend that HTTP API with arbitrary code that will be executed in V8 with direct access to the same native APIs it uses internally.

The closest equivalents I'm aware of are RethinkDB's Horizon (which isn't hosted in the database) and CouchDB's CouchApps (which are far more limited in what they can do).

You can think of it as having a subset of Node.js running right on top of the database with direct memory access and scaling (Foxx services run on each coordinator).

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#36

Post by buckbova »

don71 wrote: post #35
buckbova wrote: post #30

Earlier quoted context omitted.

Is the Foxx API supposed to imitate what would be stored procedures on the traditional rdbms?

Hi! I'm Claudius from ArangoDB. Saying Foxx is like stored procedures is overly simplistic. ArangoDB's external API is the HTTP API. Foxx lets you extend that HTTP API with arbitrary code that will be executed in V8 with direct access to the same native APIs it uses internally. The closest equivalents I'm aware of are RethinkDB's Horizon (which isn't hosted in the database) and CouchDB's CouchApps (which are far more…

So the expectation is for client applications to directly connect to the API. But of course that's not required.

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#38

Post by Diederich »

bryanlarsen wrote: post #34
Diederich wrote: post #31

Earlier quoted context omitted.

Ok, so that's a useful clarification. My problem is that I'm working for a subsidiary of a really big company that is directly competing with some parts of Facebook. There's a non-zero chance that some part of my company, far far away from me, will initiate an action that triggers this clause some time in the future. In short: my company's ability to use a growing set of otherwise high-quality projects is greatly imp…

AFAICT, Apple finds this patent grant acceptable, whereas previous versions were unacceptable. Apple is well known for suing competitors for patent infringement, so they obviously feel that the loss of this patent grant would be acceptable, that the devolution to pure BSD is enough protection.

Well, Apple certainly qualifies as a big company, thanks for the input.

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#39

Post by don71 »

buckbova wrote: post #36
don71 wrote: post #35

Earlier quoted context omitted.

Hi! I'm Claudius from ArangoDB. Saying Foxx is like stored procedures is overly simplistic. ArangoDB's external API is the HTTP API. Foxx lets you extend that HTTP API with arbitrary code that will be executed in V8 with direct access to the same native APIs it uses internally. The closest equivalents I'm aware of are RethinkDB's Horizon (which isn't hosted in the database) and CouchDB's CouchApps (which are far more…

So the expectation is for client applications to directly connect to the API. But of course that's not required.

You are right that that is not required. That ArangoDB speaks HTTP doesn't mean it has to be exposed to the browser.

You can use Foxx to host your entire server-side application inside ArangoDB in some cases but in our experience, the best approach is having a middleground where the data-intensive server-side code lives in Foxx services and the client-facing part (e.g. server-side rendering) exists outside of it.

Foxx offers you the option to put backend logic directly inside the database; it's not an all-or-nothing decision.

Re: ArangoDB 3.0 Release – A Solid Ground to Scale

#40

Post by don71 »

hexalisk wrote: post #37

I would love to see a comparison between Arangodb and Rethinkdb, especially performance wise. Is it suitable for realtime applications? What language drivers are supported?

Claudius from ArangoDB here. Frank already answered a question about realtime queries below: "We are evaluating various possibilities, how to implement streaming queries in an efficient and scalable way. For instance, are restrictions to the general AQL necessary for such queries to be able to scale? Stay tuned."

Regarding performance, it would be great if somebody with excellent knowledge about rethinkdb would contribute to https://github.com/weinberger/nosql-tests

Post reply on HN