Live data from Hacker News

The Data Engineering Handbook

github.com

21–22 of 22 posts

Re: The Data Engineering Handbook

#21
post #16

Earlier quoted context omitted.

I think it should be worth it. For the reason that you are closer to the product you are building, you help defining what to build. As opposed to programming which is more like plumbing work.

Believe me, there's a lot of plumbing moving stuff from point A to B and dealing with poop ("dirty data" is the industry euphemism) in the data engineering and data analyst space. In my more analytic moments I try to convince myself that data engineering and analysis is like chemical refining, creating useful byproducts out of raw liquids, but in my cynical moments, the plumbing metaphors for it are just so much more…

Still, somehow, I think it is where it all started in the 1950s. "I have all these numbers, I need a machine to help me do something useful".

And then after this came a huge industry with programmers.

For me it is more like back-to-basics.

Re: The Data Engineering Handbook

#22

Kimball's Data Warehousing book is excellent.

"You can save more souls with roller skates and Easy-Bake Ovens than with this 2,000-page sleeping pill" The Simpsons Season 13, Episode 6 :-) I first learned about star schemas from one of Kimball's books years ago. The content was good, but the writing style wasn’t particularly engaging. I think the books remain relevant for foundational concepts like dimensional modeling, but Kimball's focus reflected the dominant…

lol! I haven't pursued this area for some time, so I genuinely can't say.
Post reply on HN