Live data from Hacker News

The Data Engineering Handbook

github.com

11–20 of 22 posts

Re: The Data Engineering Handbook

#12

Is there a data analyst handbook? Starting a role in that soon (switching from SWE - tired of full-time programming)

Is this still a career path worth investing in? It seemed super hot a couple of years ago and then people stopped talking about it. Saw many comments complaining about lack of jobs.

Re: The Data Engineering Handbook

#13
post #12

Is there a data analyst handbook? Starting a role in that soon (switching from SWE - tired of full-time programming)

Is this still a career path worth investing in? It seemed super hot a couple of years ago and then people stopped talking about it. Saw many comments complaining about lack of jobs.

I don’t think people stopped analyzing data, but the job titles probably changed? Data scientists and data engineers are probably now doing what data analysts used to do?

Re: The Data Engineering Handbook

#14
post #12

Is there a data analyst handbook? Starting a role in that soon (switching from SWE - tired of full-time programming)

Is this still a career path worth investing in? It seemed super hot a couple of years ago and then people stopped talking about it. Saw many comments complaining about lack of jobs.

I think it should be worth it. For the reason that you are closer to the product you are building, you help defining what to build.

As opposed to programming which is more like plumbing work.

Re: The Data Engineering Handbook

#15
Nice list! Although as somebody who works on open source tools for data engineering, it kills me a little to see "companies" as the the list header rather than, say, "projects".

(also, shameless plug for my.latest project Wimsey which is non-company affiliated but does let you test data in a nice, lightweight way: https://github.com/benrutter/wimsey)

Re: The Data Engineering Handbook

#16
post #12

Earlier quoted context omitted.

Is this still a career path worth investing in? It seemed super hot a couple of years ago and then people stopped talking about it. Saw many comments complaining about lack of jobs.

I think it should be worth it. For the reason that you are closer to the product you are building, you help defining what to build. As opposed to programming which is more like plumbing work.

Believe me, there's a lot of plumbing moving stuff from point A to B and dealing with poop ("dirty data" is the industry euphemism) in the data engineering and data analyst space.

In my more analytic moments I try to convince myself that data engineering and analysis is like chemical refining, creating useful byproducts out of raw liquids, but in my cynical moments, the plumbing metaphors for it are just so much more evocative.

Re: The Data Engineering Handbook

#17

I highly recommend Fundamental of Data Engineering book [1]. Hopefully the authors can update the book soon to reflect the latest information and expand with another entire chapter for data management as they did to data architecture. [1] Fundamentals of Data Engineering: https://www.oreilly.com/library/view/fundamentals-of-data/97...

I want to second this. As a CTO I was able to use the themes and concepts to better be able help make decisions within a domain I didn’t know before reading this book.

Re: The Data Engineering Handbook

#19
post #12

Is there a data analyst handbook? Starting a role in that soon (switching from SWE - tired of full-time programming)

Is this still a career path worth investing in? It seemed super hot a couple of years ago and then people stopped talking about it. Saw many comments complaining about lack of jobs.

Despite having 4 years of experience as a SWE (excluding bachelor and CS master), it’s the only job I can get. So there’s that

Re: The Data Engineering Handbook

#20
post #13
post #12

Earlier quoted context omitted.

Is this still a career path worth investing in? It seemed super hot a couple of years ago and then people stopped talking about it. Saw many comments complaining about lack of jobs.

I don’t think people stopped analyzing data, but the job titles probably changed? Data scientists and data engineers are probably now doing what data analysts used to do?

r/dataanalysis and r/analytics still gets mang posts
Post reply on HN