Show HN: An open-source, privacy-friendly Google Analytics and GTM alternative • Hacker News Board

Re: Show HN: An open-source, privacy-friendly Google Analytics and GTM alternative

#11

Post by mekster » Wed, Jun 08, 2022, 2:42 PM UTC

scale8 wrote: post #8

drudoo wrote: post #7

Earlier quoted context omitted.

I saw the compose file but I’m wondering if I need multiple cores and a lot of ram? Can I just host it on my raspberry pi or I need to spin up a x86 server?

I'd suggest a minimum of 2GB ram. The data collection is done via Java (Micronaut project). While it can cope with thousands of requests per second quite happily on a single instance, it does require a bit of ram.

I wish apps are written in more RAM friendly languages like Go.

I don't have enough RAM to run all those Java tools. (Metabase, Sentry etc)

Re: Show HN: An open-source, privacy-friendly Google Analytics and GTM alternative

#12

Post by scale8 » Wed, Jun 08, 2022, 5:52 PM UTC

mekster wrote: post #11

scale8 wrote: post #8

Earlier quoted context omitted.

I'd suggest a minimum of 2GB ram. The data collection is done via Java (Micronaut project). While it can cope with thousands of requests per second quite happily on a single instance, it does require a bit of ram.

I wish apps are written in more RAM friendly languages like Go. I don't have enough RAM to run all those Java tools. (Metabase, Sentry etc)

I agree. We actually chose Java due to support within the community. Our first choice was Rust :)

It would not be a huge project to convert to Go or Rust though.

Re: Show HN: An open-source, privacy-friendly Google Analytics and GTM alternative

#13

Post by ramoz » Fri, Jun 10, 2022, 8:45 PM UTC

scale8 wrote: post #10

ramoz wrote: post #9

Cool, hoping to get scale8’s feedback: Are you optimizing write & read processing from BigQuery? Is there middleware (eg materialized views, pubsub, cloud funcs?) Don’t need these?

Hey @ramoz, great question. Materialized views have quite a few limitations. We have explored a few solutions using them. https://cloud.google.com/bigquery/docs/materialized-views-in... We might still introduce them in a future release to optimise a few queries. Two years ago we started with Clickhouse - we also built the aggregation pipelines around this. For data ingest we have a variety of different solutions, but…

Makes sense!! We found the same thing with redash and bigquery. We basically do the same, and don’t really need to address much at our scale.

Self-hosted will be important business enabler for you imo. SaaS isn’t so promising in the advent of data as an asset, and beyond exponential growth of data that requires more protective, diverse, and thoughtful enterprise enablement.

Re: Show HN: An open-source, privacy-friendly Google Analytics and GTM alternative

#14

Post by scale8 » Sat, Jun 11, 2022, 9:01 AM UTC

ramoz wrote: post #13

scale8 wrote: post #10

Earlier quoted context omitted.

Hey @ramoz, great question. Materialized views have quite a few limitations. We have explored a few solutions using them. https://cloud.google.com/bigquery/docs/materialized-views-in... We might still introduce them in a future release to optimise a few queries. Two years ago we started with Clickhouse - we also built the aggregation pipelines around this. For data ingest we have a variety of different solutions, but…

Makes sense!! We found the same thing with redash and bigquery. We basically do the same, and don’t really need to address much at our scale. Self-hosted will be important business enabler for you imo. SaaS isn’t so promising in the advent of data as an asset, and beyond exponential growth of data that requires more protective, diverse, and thoughtful enterprise enablement.

Good to hear we are not the only ones!

We think self-hosted might be the right direction. We are going to be putting a ton of effort and energy into our self-hosted offering over the next 6-12 months. We want to support all the major databases. At present we only have MongoDB (not idea for large projects) and BigQuery, although Clickhouse is not too far off now.