how does one end up doing BI | Data Engineering ? currently a frontend | full-stack JS dev. tired of that world and want to switch to something stable ?
Ask HN: What does your BI stack look like?
21–30 of 181 posts
Re: Ask HN: What does your BI stack look like?
#22Postgres, Pipedrive, Zendesk -> BigQuery, then BI using Holistics.io
Holistics handles both ETL, transformation and self-service visualiation (Looker alternative), all in 1 tool.
Re: Ask HN: What does your BI stack look like?
#23BI?
Business Intelligence
Re: Ask HN: What does your BI stack look like?
#24I work at Snowflake where we're dogfooding our own stuff.
Re: Ask HN: What does your BI stack look like?
#25Luigi, AWS S3, DBT, Snowflake and Re:dash (currently analyzing Metabase or Looker to allow queries without SQL) Luigi runs our scrapers and other workflow management tasks (e.g. DB backups). All raw data lives in S3. We make an effort to be able to recreate the whole data warehouse from the raw data, so if any cleaning/normalization process fails, we have this safety net. I'm curious to hear if others use a similar p…
You might want to check out Holistics.io, allowing your non-technical to explore data without writing SQL.
It's an alternative to Looker but more affordable, and more powerful than Metabase.
Re: Ask HN: What does your BI stack look like?
#26BI?
[deleted]
Re: Ask HN: What does your BI stack look like?
#27how does one end up doing BI | Data Engineering ? currently a frontend | full-stack JS dev. tired of that world and want to switch to something stable ?
Technical skills with databases are a must. It's basically a database engineer + being able to generate accurate and insightful reports/metrics/visualizations.
More value comes from database engineer skills as well as being able to understand the structure of a business. Little actually comes from the BI platform you choose.
Re: Ask HN: What does your BI stack look like?
#28If you have a data team:
Stitch / Segment -> BigQuery -> Dataform -> BigQuery -> Looker
I work with many companies helping them set up their data stack, and from what I've seen this is pretty much the optimal set up. These tools all require very little maintenance, are relatively cheap (compared to the man power required to set these things up from scratch internally), and scale well as companies grow and complexity increases.
If you don't have a data team: Segment -> Amplitude/Mixpanel
If you don't have a dedicated data team, you can do a lot with tools like Amplitude and Mixpanel. Get your engineering team set up with Segment and tracking all of the important interactions within your product, and set Segment to pass those events to Amp/Mix. Self serve analytics in these tools is then pretty easy and will serve you well until you start hiring a data team.
Full disclosure: I work for Dataform (used to be a customer, loved it so much I decided to join them)
Re: Ask HN: What does your BI stack look like?
#29I work at Snowflake where we're dogfooding our own stuff.
[deleted]
Re: Ask HN: What does your BI stack look like?
#30If you have a data team: Stitch / Segment -> BigQuery -> Dataform -> BigQuery -> Looker I work with many companies helping them set up their data stack, and from what I've seen this is pretty much the optimal set up. These tools all require very little maintenance, are relatively cheap (compared to the man power required to set these things up from scratch internally), and scale well as companies grow and complexity…
Thanks for sharing, I don’t think there’s an “optimal setup” in the objective sense but good to know this works well.