Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cayley – An open-source graph database

github.com

Post reply on HN
Print view View original

21–30 of 60 posts

Re: Cayley – An open-source graph database

#21

Post by rspeer »

baq wrote: post #10
moondowner wrote: post #5

Earlier quoted context omitted.

http://orientdb.com/orientdb/

have you used it on non-trivial scales? did it turn out ok for you? any major outstanding issues? asking because i've looked at it a couple of years back and decided to go with SQL but the project looked reeeaally interesting back then and it still might fit for new development.

I tried OrientDB. It's not clear how to use their fast data importer on data that's actually structured as a graph (instead of "hey, I've got a SQL database that I want to put into a graph database for some reason"). A couple of their employees have responded to me once but haven't actually answered the question.

I also tried it before they had a fast data importer and... well, you need a fast data importer.

Re: Cayley – An open-source graph database

#22

Post by willcodeforfoo »

sidi wrote: post #2

The project has no activity in the last 6 months. I would like to see an open-source graph database that's being actively developed and maintained.

I know neo4j is the 800 lb. gorilla in this space, but it's interesting it has way more stars (almost 8K) than neo4j's almost 3K.

Re: Cayley – An open-source graph database

#23

Post by rspeer »

indatawetrust wrote: post #3
sidi wrote: post #2

The project has no activity in the last 6 months. I would like to see an open-source graph database that's being actively developed and maintained.

https://github.com/neo4j/neo4j

Neo4j, like all graph databases I've tried, is only okay with small data.

Suppose I want to import a medium-sized graph into Neo4j. Medium-sized as in "fits on a hard disk and doesn't quite fit in RAM". One example would be importing DBPedia.

Some people have come up with not-very-supported hacks for loading DBPedia into Neo4j. Some StackOverflow comments such as [1] will point you to them, and the GitHub pages will generally make it clear that this is not a process that really generalizes, just something that worked once for the developer.

[1] http://stackoverflow.com/questions/12212015/how-to-setup-neo...

Now suppose you want to load different medium-sized graph-structured data into Neo4j. You're basically going to have to reinvent these hacks for your data.

And the last time I tried to load my multi-million-edge dataset into Neo4j through its documented API, I estimated that it would have taken several weeks to finish.

Don't tell me that I need some sort of enterprise distributed system to import a few million edges. Right now I keep these edges in a hashtable that I wrote myself, in not-very-optimized Python, that shells out to "sort" for the computationally expensive part of indexing. It's not a very good DB but it gets the job done for now. It takes about 2 hours to import.

Re: Cayley – An open-source graph database

#24

Post by [deleted] »

ocdtrekkie wrote: post #7

"Not a Google project, but created and maintained by a Googler" Interesting location, being in the main Google organization, given this disclaimer. I've seen other projects with this disclaimer under Googlers' personal pages before, and I always figured a /google/ URL probably meant it was officially a Google project.

[deleted]

Re: Cayley – An open-source graph database

#26

Post by kajecounterhack »

sidi wrote: post #2

The project has no activity in the last 6 months. I would like to see an open-source graph database that's being actively developed and maintained.

http://github.com/google/badwolf

Graph store currently being used by Google's Spam & Abuse Team. Last commit last week.

Re: Cayley – An open-source graph database

#29

Post by mwambua »

rspeer wrote: post #23
indatawetrust wrote: post #3

Earlier quoted context omitted.

https://github.com/neo4j/neo4j

Neo4j, like all graph databases I've tried, is only okay with small data. Suppose I want to import a medium-sized graph into Neo4j. Medium-sized as in "fits on a hard disk and doesn't quite fit in RAM". One example would be importing DBPedia. Some people have come up with not-very-supported hacks for loading DBPedia into Neo4j. Some StackOverflow comments such as [1] will point you to them, and the GitHub pages will…

Very interesting. I think the reality in a lot of situations is that most people don't really need the full feature-set that graph databases provide.

I ran into a similar problem trying to explore Wikidata's json dumps. It's a lot simpler to load it into MongoDB and create indices where you need them, rather than figuring out how to interface to a proprietary system that you may or may not end up using in the long run.

I'm still having trouble keeping my indices in memory though, and would be keen to know what sort of latency you encounter hitting an on-disk hashtable.

Re: Cayley – An open-source graph database

#30

Post by lolive »

rspeer wrote: post #23
indatawetrust wrote: post #3

Earlier quoted context omitted.

https://github.com/neo4j/neo4j

Neo4j, like all graph databases I've tried, is only okay with small data. Suppose I want to import a medium-sized graph into Neo4j. Medium-sized as in "fits on a hard disk and doesn't quite fit in RAM". One example would be importing DBPedia. Some people have come up with not-very-supported hacks for loading DBPedia into Neo4j. Some StackOverflow comments such as [1] will point you to them, and the GitHub pages will…

FYI, we have had EXTREME performance with the LOAD CSV feature of Cypher.
Post reply on HN