Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Minimally Invasive (and More Accurate) Analytics: GoAccess and Athena/SQL

brandur.org

Post reply on HN
Print view View original

31–35 of 35 posts

Re: Minimally Invasive (and More Accurate) Analytics: GoAccess and Athena/SQL

#31

Post by twotwotwo »

bitsondatadev wrote: post #30
twotwotwo wrote: post #19

I want to second that plug for Athena for ad-hoc analysis. (If you're hosting your own stuff and at the scale where it'd be useful, there's Presto/Hive, which Athena is based on, and/or at Trino, the Presto fork maintained by some of its initial developers.) It was useful for me when tweaking spam/bot detection rules a while ago; if I could roughly describe a rule in a query, I could back-test it on old traffic and f…

One quick detail on the Trino description is that not only are some of the initial developers but all of the creators and the majority of contributors ( https://github.com/prestodb/presto/graphs/contributors?from=... ) and still have contributed the majority of the code in both Presto ( https://github.com/prestodb/presto/graphs/contributors)/Trin... ( https://github.com/trinodb/trino/graphs/contributors ). To really…

Yeah, when I was looking into this stuff it was sad to see the blog post about why Trino had to switch names. Unsurprisingly given the history, the Trino blog was the only place I could find written-up details about things like how to name files so they work with the new version of bucketing. The new features look really neat and hope the project has (continues to have) success!

Re: Minimally Invasive (and More Accurate) Analytics: GoAccess and Athena/SQL

#32

Post by findepi »

twotwotwo wrote: post #31
bitsondatadev wrote: post #30

Earlier quoted context omitted.

One quick detail on the Trino description is that not only are some of the initial developers but all of the creators and the majority of contributors ( https://github.com/prestodb/presto/graphs/contributors?from=... ) and still have contributed the majority of the code in both Presto ( https://github.com/prestodb/presto/graphs/contributors)/Trin... ( https://github.com/trinodb/trino/graphs/contributors ). To really…

Yeah, when I was looking into this stuff it was sad to see the blog post about why Trino had to switch names. Unsurprisingly given the history, the Trino blog was the only place I could find written-up details about things like how to name files so they work with the new version of bucketing. The new features look really neat and hope the project has (continues to have) success!

Thanks!

You mean Hive bucketing v2? It was a fun project.

Re: Minimally Invasive (and More Accurate) Analytics: GoAccess and Athena/SQL

#33

Post by twotwotwo »

findepi wrote: post #32
twotwotwo wrote: post #31

Earlier quoted context omitted.

Yeah, when I was looking into this stuff it was sad to see the blog post about why Trino had to switch names. Unsurprisingly given the history, the Trino blog was the only place I could find written-up details about things like how to name files so they work with the new version of bucketing. The new features look really neat and hope the project has (continues to have) success!

Thanks! You mean Hive bucketing v2? It was a fun project.

Yep! I had a situation where I wanted more than one file per bucket (for the sake of other code that uses the same data), and needed the improved bucketing for that.

Re: Minimally Invasive (and More Accurate) Analytics: GoAccess and Athena/SQL

#34

Post by bitsondatadev »

twotwotwo wrote: post #31
bitsondatadev wrote: post #30

Earlier quoted context omitted.

One quick detail on the Trino description is that not only are some of the initial developers but all of the creators and the majority of contributors ( https://github.com/prestodb/presto/graphs/contributors?from=... ) and still have contributed the majority of the code in both Presto ( https://github.com/prestodb/presto/graphs/contributors)/Trin... ( https://github.com/trinodb/trino/graphs/contributors ). To really…

Yeah, when I was looking into this stuff it was sad to see the blog post about why Trino had to switch names. Unsurprisingly given the history, the Trino blog was the only place I could find written-up details about things like how to name files so they work with the new version of bucketing. The new features look really neat and hope the project has (continues to have) success!

Thanks! If you haven't, feel free to join our slack if you have any further questions. https://trino.io/slack.html

We're trying to improve the docs and blog about confusing topics. We also started a twitchcast to dig into various technical topics around Trino: https://www.twitch.tv/trinodb. You can catch old episodes here: https://trino.io/broadcast/episodes.html.

Re: Minimally Invasive (and More Accurate) Analytics: GoAccess and Athena/SQL

#35

Post by [deleted] »

twotwotwo wrote: post #31
bitsondatadev wrote: post #30

Earlier quoted context omitted.

One quick detail on the Trino description is that not only are some of the initial developers but all of the creators and the majority of contributors ( https://github.com/prestodb/presto/graphs/contributors?from=... ) and still have contributed the majority of the code in both Presto ( https://github.com/prestodb/presto/graphs/contributors)/Trin... ( https://github.com/trinodb/trino/graphs/contributors ). To really…

Yeah, when I was looking into this stuff it was sad to see the blog post about why Trino had to switch names. Unsurprisingly given the history, the Trino blog was the only place I could find written-up details about things like how to name files so they work with the new version of bucketing. The new features look really neat and hope the project has (continues to have) success!

[deleted]
Post reply on HN