Live data from Hacker News

Ask HN: Am I too late for the “Data Science” wave?

news.ycombinator.com

121–130 of 148 posts

Re: Ask HN: Am I too late for the “Data Science” wave?

#121
post #6

If I may give you an advice : Python, R and deep learning are sexy but the most important skill to start in data science is SQL. It will help you get your first data role and will be your main tool to solve 97% of the problems you will ever face. Bonus point it is very easy to learn.

SQL is almost never used in algorithmic trading by data scientists. Learn Python, it is used universally. Don't learn R.

Why not learn R? In the last year I've spent around 80% of my time working with R, coming from the last five years almost exclusively with Python, and there are some great reasons to use R. Although if the tidyverse didn't exist I'm not sure I'd be saying that. I find that suite of packages together to be a very cohesive set of tools for doing data science.

Re: Ask HN: Am I too late for the “Data Science” wave?

#122
post #116

If you are already a PHD do you have chance to do something with big data in the domain? I'm sure there are some big data projects you can do in agriculture. PHD in DNA research tend to have much more relevant experience than those who just go through a few training camp courses as they have to build models for PB level data, which forces them to use CLI and optimize their algos and use advanced tools such as Hadooo,…

very valuable advise. DS itself is nothing unless it is implemented in a specific domain.

Yeah. I'd really want to work as a data engineer for a Bio phd that deals with pb data, for free or even pay a small fee...

Re: Ask HN: Am I too late for the “Data Science” wave?

#123
Genuinely shocked by this question. There is no part of the data science stack that is in any way settled. Even more broadly I don’t think statistical best practice is at all established, or at least well distributed.

You haven’t even missed the boat in terms of being able to make money off raw buzzwords and zero skills.

At the very basic technical level, there’s infinite work to be done optimising machine learning systems. This includes not just the fashionable issues of faster more accurate (or even less accurate in terms of floating point!) deep learning, but also moving Bayesian approaches like MCMC to multiple cores and GPUs.

There’s infinite work to be done on finding the right topology for a machine learning system. This applies not just to neural network layers but also to traditional stats (i.e. multiverse analysis).

There’s infinite work to be doing in understanding, cleaning and preparing datasets. Something as clunky as tidyverse can’t be close to the final form here. We’ve only just started talking about feature stores etc.

There’s infinite work to be done improving notebooks, integrating better software engineering practise into the workflow but also in terms of productionisation of models created therein.

All this is just platform stuff as well. It doesn’t even touch on the fact that businesses everywhere are terrible at formulating questions to be answered by stats, terrible at communicating those answers and terrible at even knowing this is a valuable endeavour in the first place.

I cannot imagine a boat harder to miss.

Re: Ask HN: Am I too late for the “Data Science” wave?

#124
post #109

Earlier quoted context omitted.

What kind of math? It takes me a while to learn math so any focused area would help cut down the time taken immensely (not that I don't enjoy learning tidbits like supremum/infimum)

Multivariable calculus, differential equations, linear algebra, probability theory, statistics.

Ranked from most to least essential, I'd suggest: probability, statistics, linear algebra, basic calculus, operations research, multivariate and partial and vector calculus, diff eq.

Re: Ask HN: Am I too late for the “Data Science” wave?

#125
Climate change and carbon.

Ag, farmers, lawn owners are all errr... "ripe for disruption" as their genetic systems lag and only innovate at a the paltry rate of once per season.

There are many ways to play the field (no pun intended) from predicting and capitalizing on misfortune to minimizing the same. I hope some will be most interested in using our talents to mitigate crop failures, maximize sustainable nutrition or find the optimal low risk carbon sink.

Re: Ask HN: Am I too late for the “Data Science” wave?

#126
post #20
post #6

If I may give you an advice : Python, R and deep learning are sexy but the most important skill to start in data science is SQL. It will help you get your first data role and will be your main tool to solve 97% of the problems you will ever face. Bonus point it is very easy to learn.

I work as a data scientist and every statement in your post sounds incorrect to me. SQL is useful but it's far from the most important tool. It's certainly unlikely to land you a job. It definitely won't solve 97% of problems. You either have a very skewed perspective of what data science is or you spend a lot of time on linkedin/medium where bad advice like this is parroted a lot. Think about this - there are a bunc…

> there are a bunch of other software developers who know SQL very well. If your advice was true, then every backend developer would be able to immediately land a data science job

I fully disagree. Most backend developers don't know SQL beyond their ORM library or CRUD statements. The business intelligence world has utilized SQL to analyze data and make effective business decisions for 40+ years.

ML is 90% hype to check a box for investors, and the actual business problems could be solved by a semi-competent analyst armed with Excel or SQL, not a bunch of overpaid "scientists" who completed a few Andrew Ng courses.

Re: Ask HN: Am I too late for the “Data Science” wave?

#127
post #103

As someone with a PhD in a different field who's made that switch, I actually have to disagree with most of the advice here. This is a bit too bitter and jaded (I'm not quite this pessimistic), but I think it needs to be said to counter a lot of the rosier advice. Having a PhD in a non-CS field is a _massive_ negative in the eyes of potential employeers. Even if you're looking at moving into a role where your domain…

I'm going to chime in to disagree strongly with this. I've seen and worked with lots of non-CS PhDs in data science who have been terrific. It's pretty common too—there's even the Insight program that trains PhDs to go into data science [1]. I don't think it will be seen as a downside and will instead show that you know how to do research and solve problems. [1] https://insightfellows.com/data-science

Anecdotal, but I’ve worked with dozens of PhD data scientists, and not one of them had a CS PhD. The most common one I see is physics, followed by math. (And I don’t work in a physics-related field.)

Re: Ask HN: Am I too late for the “Data Science” wave?

#128
post #109

Earlier quoted context omitted.

Multivariable calculus, differential equations, linear algebra, probability theory, statistics.

Ranked from most to least essential, I'd suggest: probability, statistics, linear algebra, basic calculus, operations research, multivariate and partial and vector calculus, diff eq.

True but order of importance is different from order of study. You should really start with calculus because you can't study probability without it.

Re: Ask HN: Am I too late for the “Data Science” wave?

#129
post #48

I've worked at productionising data science models for the past 4 years. I'm currently responsible for delivering technology platforms to ~180 data scientists. I find the data scientist label misleading. Roughly 70% of of the data scientists I've encountered are actually Excel analysts with little experience outside of a Windows desktop bar Facebook on a Mac. They're unable to use basic software engineering tools suc…

This is a deeply misleading (though somewhat accurate) comment. The reason it's misleading is because the 70% above (who may be called data scientists) are not actually data scientists, at best they are data analysts. In general, the core difference between data scientists and data analysts is that the former can code in at least one language (SQL doesn't count, unfortunately). However, because the term data science…

Didn't facebook start this by calling their Data Analysts Data Scientists?

Re: Ask HN: Am I too late for the “Data Science” wave?

#130
post #24

I work as a data scientist and have some perspective on this. There's no boat to miss, you'll probably be fine. Just keep a couple of things in mind - The fundamental skills that you need are mathematics and software engineering. Depending on your background it might take years of additional studying. - There is a big oversupply of people for the junior-mid level data science jobs. There are more people who want to g…

"There is a big oversupply of people for the junior-mid level data science jobs."

I feel this is true for most tech jobs. I see tons of senior job postings, but relatively very few entry-level or mid-level postings.

Post reply on HN