Live data from Hacker News

Ask HN: What's the state of the job market in data science and machine learning?

news.ycombinator.com

131–140 of 140 posts

Re: Ask HN: What's the state of the job market in data science and machine learning?

#131
post #36
post #23

Speaking for NYC, but I imagine silicon valley is similar. The supply-demand dynamics have changed a lot in the last couple years. I'd roughly break it out into two groups: people with work experience + strong software development skills, and those without. The first group is in higher demand than ever, and tend to add a lot of value to companies that really need it. The second group has gotten extremely crowded, esp…

Frankly, MOOC-type machine learning- being able to do plain vanilla logistic regression or black-box deep learning techniques is not enough to get a job. This knowledge and experience has to be paired with one or more strengths: excellence in programming, grad-level math/stat/numerical skills/theoretical machine learning, domain specific expertise or experience (e.g. vision, audio, natural language, networks, geophys…

So... for instance an MD with MOOC-type machine learning could make it in health related enterprises? Is that what you mean by domain specific expertise?

Re: Ask HN: What's the state of the job market in data science and machine learning?

#132
post #84

I'm in Australia. I'm hiring 6 people in a range of roles between "pure" data scientists to more data engineer/SWE roles. The exact mix depends on who we can get. The ability to find good people is the biggest constraint on the work we do. Our current team ranges from applied mathematicians (as in they are Math professors) to people with traditional SWE backgrounds. Basically we are a long long way from saturated.

What is your company? I am Australian, finishing a PhD in mathematics and looking for a job.

Email me. Contact details in my profile.

Re: Ask HN: What's the state of the job market in data science and machine learning?

#133
post #15

Earlier quoted context omitted.

Companies that have a research division and a separate engineering team to implement the research ideas are rarely successful. Anyone engineer good enough to do the implementation will figure out they can build something better without the input of the researchers. Microsoft and Yahoo both had great research teams whose ideas rarely saw the light of day.

I didn't say to put them in two separate divisions. Put both guys in the same place, working closely with each other. Any engineer will quickly figure out that he's out of his depth in the maths & statistics. Any mathematician will quickly figure out that he's out of his depth in the system building.

And this is why a lot of trading desks would couple a trader with a quant with a technologist.

Re: Ask HN: What's the state of the job market in data science and machine learning?

#134
post #36

Earlier quoted context omitted.

Frankly, MOOC-type machine learning- being able to do plain vanilla logistic regression or black-box deep learning techniques is not enough to get a job. This knowledge and experience has to be paired with one or more strengths: excellence in programming, grad-level math/stat/numerical skills/theoretical machine learning, domain specific expertise or experience (e.g. vision, audio, natural language, networks, geophys…

So... for instance an MD with MOOC-type machine learning could make it in health related enterprises? Is that what you mean by domain specific expertise?

That's stretching it. I think I should have qualified domain specific expertise as quantitative-domain specific expertise. Afaik, MD is more about human biology and meant to help you become a practicing doctor. PhD-biomedicine, MPH/MS-bioinformatics, or MD-PhD programs tend to have more substantial quantitative components than just an MD. Caveat: these are gross generalizations. I know some MDs who are competent enough in quantitative analysis to give any engineer a run for their money!

Would an English MA or PhD, for example couple well with an ML-MOOC for natural language processing jobs? Possibly, but would involve a lot of effort to build the bridge. However, if someone has a mechanical engineering degree or a PhD in something similar, a MOOC-ML can work well to position them for a bunch of jobs in large mechanical engineering companies looking to jump on the ML bandwagon or ones traditionally strong in ML-type mechanical engineering like UTC.

Re: Ask HN: What's the state of the job market in data science and machine learning?

#135
post #66

In my limited experience, there's a difference between a data scientist who can process data given data and a set of questions about it, and a data scientist who can figure out what data you need, and the questions that need to be answered. I think making the transition from the first role to the second role comes with experience, both with the toolsets, and thinking about the problem as a whole.

> data scientist who can figure out what data you need, and the questions that need to be answered. Isn't that describing a statistician?

Isn't that how the joke goes? A data scientist is a statistician in California...

Re: Ask HN: What's the state of the job market in data science and machine learning?

#136
post #23

Speaking for NYC, but I imagine silicon valley is similar. The supply-demand dynamics have changed a lot in the last couple years. I'd roughly break it out into two groups: people with work experience + strong software development skills, and those without. The first group is in higher demand than ever, and tend to add a lot of value to companies that really need it. The second group has gotten extremely crowded, esp…

There's always room for smart, hard working and creative thinkers in any field. Except maybe marine biology. But as in any lucrative field, e.g. law, you have a wide variety of capabilities and work quality. After 10 years in quantititative work (I got an MS in Applied Math before they were calling Statistics "Data Science") I can say that it's just a tough field to work in. Experience goes further than education, but education (yes, a real accredited graduate level education) is necessary. The most challenging aspect of DS isn't the technical aspects, it's being able to have a thick enough skin to not let the skeptical and reluctant engineering types upon who you depend to implement your brilliant models get under your skin and enough patience to explain and convince the skeptical and not too savvy business types who cut your checks, that their intuition is wrong and your math is right. And then of course, there's the inevitable boredom that comes with solving yet another mundane business problem with the simplest and least sexy tools. I'm not complaining, just saying that almost all STEM graduates turned DS I've ever worked with have a small hollow spot in their soul that burns with passion for the astrophysics or theoretical math problems they traded in for the perk filled corporate life.

3 easy steps to get a job in DS if you want them though: Grad Degree in Math/Stats/CompSci; work on a bunch of hard to predict problems and then publish and present them to your local meetup community to gain experience; learn engineering tools and devops and be about 90% as good a software engineer as your team's actual engineers (git, hg, IDEs, java, pig)... your brilliant models are way less important than being able to help the already overwhelmed engineering team make them work.

Re: Ask HN: What's the state of the job market in data science and machine learning?

#137

From someone who is looking to transition to data science, the field is terrible if you haven't had an industry job before. I am ranked in the top 150 on Kaggle and can't even get phone interviews without someone in my network recommending me for a position.

Post a link to your resume. There may be some obvious problems we can diagnose.

Re: Ask HN: What's the state of the job market in data science and machine learning?

#138
post #93

Earlier quoted context omitted.

Just tried applying, but the page for the data scientist remote position doesn't load correctly.

Please send me your resume directly to simon.hughes@dice.com. Apologies for the issues with the link. I've notified our HR department, hopefully they will address it.

This links directly to the dice.com version of the posting (same position).

http://www.dice.com/jobs/detail/-/Diceinc/790523?rno=7814317...

The application process via that link is smoother, or so I am told. Please note that while this position is remote, we are only looking for US citizens or Visa holders located within the US right now. Dice.com link:

Re: Ask HN: What's the state of the job market in data science and machine learning?

#139

I am the Chief Data Scientist of Dice.com. If you are interested in working as a junior Data Scientist, and are smart and hard working, please apply here: http://careeropportunities.dhigroupinc.com/ . The position is a telecommute role. We will absolutely consider people with no data science experience, so long as they demonstrate an aptitude for data science \ machine learning and can code.

For those with difficulties accessing the link, I apologize. I have notified HR, who maintain that aspect of the site. In the meantime, please email me your resumes to simon.hughes@dice.com

*

1 point by simonhughes22 0 minutes ago | edit | delete [-]

This links directly to the dice.com version of the posting (same position). http://www.dice.com/jobs/detail/-/Diceinc/790523?rno=7814317.... The application process via that link is smoother, or so I am told. Please note that while this position is remote, we are only looking for US citizens or Visa holders located within the US right now.

Re: Ask HN: What's the state of the job market in data science and machine learning?

#140

Earlier quoted context omitted.

For those with difficulties accessing the link, I apologize. I have notified HR, who maintain that aspect of the site. In the meantime, please email me your resumes to simon.hughes@dice.com

* 1 point by simonhughes22 0 minutes ago | edit | delete [-] This links directly to the dice.com version of the posting (same position). http://www.dice.com/jobs/detail/-/Diceinc/790523?rno=7814317... . The application process via that link is smoother, or so I am told. Please note that while this position is remote, we are only looking for US citizens or Visa holders located within the US right now.

thanks
Post reply on HN