[deleted]
Crate.io – Big Data SQL in real time
21–30 of 83 posts
Re: Crate.io – Big Data SQL in real time
#22If you were initially confused like I was, crate.io used to be the domain for an alternative Python Package Index.
http://www.reddit.com/r/Python/comments/1wcp93/what_happened...
Re: Crate.io – Big Data SQL in real time
#23It would be helpful to know the largest data set this has been used with and the performance of some example queries. Ideally > 1TB to qualify as "big data".
Re: Crate.io – Big Data SQL in real time
#24Nicely done and thoughtfully executed. As a quibble on the suggested use cases, this platform will not work for the Internet of Things generally for two reasons. First, it lacks support for the spatial data types, including polygons, and operations, including spatial joins, that are typical of those types of data models. Second, typical commercial IoT data sources are often on the order of 100TB-1PB per day , which i…
so what kind of tool would you recommend instead to deal with 100TB-1PB per day ? I'm genuinely interested.
Re: Crate.io – Big Data SQL in real time
#25I'm just trying this out of curiosity and I haven't been able so far to find how to restrict the access to the admin panel (not per IP but per user/pass or event public key / certificate).
Re: Crate.io – Big Data SQL in real time
#26Anybody who comes up with a new "Big Data" solution has to realize that the 90% of the data users are vested deeply in Hadoop and the ecosystem around it. Having tools like PrestoDB, Hive, Shark on the top of HDFS makes it really hard to newcomers to convince companies to invest in something else. If data was a greenfield territory these project would be more viable. Btw. on this note, PrestoDB just getting the right features like join optimization, support for nested structures, etc.
Re: Crate.io – Big Data SQL in real time
#27If you were initially confused like I was, crate.io used to be the domain for an alternative Python Package Index. http://www.reddit.com/r/Python/comments/1wcp93/what_happened...
I visited crate.io last month and remembered this. It was more than a little confusing at first.
Re: Crate.io – Big Data SQL in real time
#28No Joins?
Right, what were they thinking? :)
Re: Crate.io – Big Data SQL in real time
#29190k records is Big Data? For me big data starts from 9M+ rows
9M rows? Luxury! Big data starts at 100M rows! /s
Re: Crate.io – Big Data SQL in real time
#30"It includes solid established open source components (Presto, Elasticsearch, Lucene, Netty) and extends those with added core functionalities like read/write support, a SQL interface, a dashboard and a query console."
This makes no sense. Presto is already a SQL query engine, so what does it mean to "extend" it with a SQL interface? Furthermore, the crate.io SQL is even more limited than Presto SQL! Presto allows operations that are not in crate SQL, like joins and "create table as select".