[deleted]
Show HN: We wrote a book to help data people build scalable analytics stacks
11–18 of 18 posts
Re: Show HN: We wrote a book to help data people build scalable analytics stacks
#12Really well done! The content looks like a great balance. I'm an engineer working a bit in data engineering, and I find the content of the book relevant to me. I like how you explain why the methodologies of the pre-cloud era still have lessons learned to apply to today, but implementation best practices have changed thanks to the cost model of the cloud. The section that stood out the most to me, strangely, was not…
Thank you for sharing your thoughts! Yes the concept of data modeling and self-service analytics are interesting, yet few people fully grasp it. Chapter 3.1 is probably one of my most favorites.
Re: Show HN: We wrote a book to help data people build scalable analytics stacks
#13Great book and spot on of the problem statement. One interesting note to point out is I didn't see any mention of testing your data models or version control? This should be part of the process of the modern analytics stack to ensure data quality. A suggestion of approaches and tools could be useful. Whether it's via tools such as dbt for expected field values or with frameworks such as GreatExpectations. What happen…
Yes.. we did get a number of early feedback about this exact topic of data quality. But we eventually decided to cover it in another separate sidebar to the book. It’s also not a simple topic to cover. And the book is supposed to “give you enough to be dangerous”.
Re: Show HN: We wrote a book to help data people build scalable analytics stacks
#14This is just the book I need!
A little bit of context: I am a product manager and I have been working with data analysts and engineers for a few months, and even though I have tried to do a lot of research, sometimes I still don't understand what they said.
Terms are extremely difficult and varied depending on the site, and it seems like each company will have a different perception for one term.
So that's where this book comes in handy. It helped me visualize the big picture of the whole data analytics landscape. What's more, I understand what the role and challenges of the data analysts and data engineers in my team are. I was able to communicate with them in their "language", especially when I was explaining why we should use ELT instead of ETL (Chap 3, I suppose)
Anw, I think this book is great for non-tech people like me, but it requires certain experience in the tech industry to get started with. Definitely recommend for other PMs who will be working with data people!
Re: Show HN: We wrote a book to help data people build scalable analytics stacks
#15Very nice drawings, what tool was used ?
Re: Show HN: We wrote a book to help data people build scalable analytics stacks
#16Amazing that we can get such high quality resources for free. That said, I'm not convinced by the example where the CEO uses the "data modelling layer" (essentially what holistics offers to build for you and what this book is an ad for). In my experience a good data analyst does far more than "translate" the business question to SQL. The exec's understanding is not only limited by not knowing SQL, but also by potential confounds or a billion other things that can make a seemingly meaningful result meaningless or dangerous.
I don't think simpler technology can give people the magic answers and easy data access that they crave any more than no code tools can let people build complicated correct systems
Re: Show HN: We wrote a book to help data people build scalable analytics stacks
#17Very nice drawings, what tool was used ?
We used iPad, Apple Pencil and Paper app :)
Re: Show HN: We wrote a book to help data people build scalable analytics stacks
#18Amazing that we can get such high quality resources for free. That said, I'm not convinced by the example where the CEO uses the "data modelling layer" (essentially what holistics offers to build for you and what this book is an ad for). In my experience a good data analyst does far more than "translate" the business question to SQL. The exec's understanding is not only limited by not knowing SQL, but also by potenti…
You’re right, and also right that we might be biased. We actually not trying to say that with the modeling layer the CEO can remove her reliance on the DA completely, that would be foolish. We think she can only reduce that reliance down when it only comes to getting access to data. We are not talking about complicated analysis that requires a proper data mindset.