Live data from Hacker News

Crate.io – Big Data SQL in real time

crate.io

1–10 of 83 posts

Re: Crate.io – Big Data SQL in real time

#3
Looks like it has a lot of potential for data scientists. Relatively simple set up with little maintenance is key for data science, especially those with less hardcore dev experience. I'd be interested to know if there is any support for queries too large for Presto / Lucene to handle. Give me arbitrary map-reduce and I'll be in love.

Re: Crate.io – Big Data SQL in real time

#4
Interesting.

Nevertheless, just by browsing the documentation, it seems they only support very basic SQL. For example, joins are not supported.

To me, "SQL support" basically entails taking advantage of the relational model. In here, "SQL Support" means "you can use something that looks like a SQL-like syntax to insert and fetch records from a table". Those are two very different things.

I do understand why they did that though. Automatic sharding of a single table in a cluster is much simpler problem than auto-scaling cross cluster joins.

I'll still download and take a look at the project since conceptually it is interesting.

Re: Crate.io – Big Data SQL in real time

#8
This is a cool idea. Its good to see that SQL is a driver in new data management technologies. It supports the idea that as applications change over the years, the data model should try to remain the same.

My view is that it's always a good idea to wait until a data management platform or db is widely adopted before using it for anything. For some reason I don't like the idea of using the word 'realtime' for what's really just very fast queries but that may be nitpicking. I think of real-time as something where you're given a real-time view of some data where you don't have to query for updates.

Post reply on HN