Live data from Hacker News

The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

trino.io

21–30 of 70 posts

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#21

Earlier quoted context omitted.

Check out this PR. I believe we may have tackled this one but you'd need to try it out on Trino: https://github.com/trinodb/trino/pull/1415

Hooray! Yet another data point for Trino > Presto as far as I'm concerned ;^)

If you want to try an SaaS Athena alternative that's backed by Trino you can check out Starburst Galaxy: https://www.starburst.io/platform/starburst-galaxy/

Full disclosure I work at Starburst.

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#22

Big shout out to Brian Olsen from the Trino community (and Starburst) for helping the Trino community be successful - https://github.com/bitsondatadev - https://www.linkedin.com/in/bitsondatadev/ I recommend the Trino Slack for people not already in it: https://trino.io/slack.html

Thanks for the shoutout! :)

If you want to get started with Trino, here's a repo I created to do so: https://github.com/bitsondatadev/trino-getting-started

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#23
post #15

I do the support for my department's trino cluster. We move ~1tb (and growing) in ETL jobs and support interactive queries for the data scientists/analysts. It would be super good if you guys added big query write support. Its really annoying to have to run a hive cluster in google to act as a proxy for this.

BigQuery very recently announced their Storage Write API which is one of the ways we were looking to implement this but there are some issues with the latency and consistency guarantees that it offers.

But, yes, we do plan to add that eventually after ironing out all the kinks. See https://github.com/trinodb/trino/pull/13094

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#24
post #9

Can Trino be used as a Snowflake replacement? How is the query speed compared to Snowflake?

i can't speak to trino, but with my experience with aws athena and snowflake, they're roughly on par with each other across the board.

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#26

Earlier quoted context omitted.

Hooray! Yet another data point for Trino > Presto as far as I'm concerned ;^)

If you want to try an SaaS Athena alternative that's backed by Trino you can check out Starburst Galaxy: https://www.starburst.io/platform/starburst-galaxy/ Full disclosure I work at Starburst.

Oh nice, I have high opinions of you folks!

Guy who goes by the name of "Randgalt" online builds some great Java libraries and works there too I believe.

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#27
One of the features I'm interested in (or would like to have) from Trino or Presto is the workload management which can better manage different types of queries and allocate resources accordingly. This becomes important when more applications adopt Trino or Presto as a distributed SQL database/platform, where the impact from different queries or workloads can be mitigated, besides the dedicated resources (CPU, MEM, etc.) can be allocated to high priority workloads. I'm really wondering if/when such capabilities may be provided.

BTW, purely curiosity, I compared Trino with Presto from OSS point of view (https://ossinsight.io/analyze/prestodb/presto?vs=trinodb%2Ft...), both communities are still popular but Trino seems more active than Presto now. I also wonder if two communities may reunion someday again to really boost its impact (comparing to Spark community).

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#28
post #8

I recently had to write SQL query generation for AWS Athena, which is based off Presto 0.217 It turns out that the dialect doesn't support LATERAL joins with a LIMIT in them. The below query only works if you remove the LIMIT clause. https://i.stack.imgur.com/rdB1s.png This makes saying things like "Fetch all artists where ..., for each artist fetch their first 3 albums where ..., and for each album fetch the top 10…

AWS Athena: selling a buggy, old, stale copy of someone else's work (Presto / Trino) for high prices and getting away with it because you control the platform. If that's not peak Amazon, I don't know what is.

Can’t you say the same thing for EC2 but with Linux instead of Presto? Personally I like Athena. The fact that it’s in the Amazon platform and managed is a plus for me.

Re: The SQL query engine Trino (formerly PrestoSQL) recaps a decade of innovation

#30
post #29

Trino vs ClickHouse, can anyone tell from experience how those two compare?

Clickhouse is a realtime system where Trino is a batch-oriented system. There are tradeoffs for doing realtime vs batch.

Realtime is generally more expensive to run as you process every individual row as it comes, batch is when you can deal with minute latency and want to handle a lot of data in chunks.

Trino is also a query engine rather than a database and it connects to many different systems: https://trino.io/docs/current/connector.html

It also happens to connect to Clickhouse and it's very common that people will use Trino to query clickhouse realtime data and join it with data in big query, an object store data lake, or Snowflake: https://trino.io/docs/current/connector/clickhouse.html

Post reply on HN