Live data from Hacker News

Deep learning job postings have collapsed in the past six months

twitter.com

251–260 of 274 posts

Re: Deep learning job postings have collapsed in the past six months

#251
post #84

Earlier quoted context omitted.

>If you think about it, that's the natural outcome. Why? Because people in corporations don't have the incentive to benefit the business but to progress their careers and that's done through meeting the goals for their position and make their upper ups progress with their careers too. This is one of the reasons I roll my eyes whenever I read something like "McKinsey says 75% of Big Data/AI/Buzzword projects do not de…

Followed immediately by the solution: Hire McKinsey analysts to help you deliver insights -- which may or may not get implemented or deliver the results, but it won't matter because everyone has moved on to the next "project".

[deleted]

Re: Deep learning job postings have collapsed in the past six months

#253

Earlier quoted context omitted.

> they paid more to get those insights than they were worth! This understates how awful ML is at many of these companies. I've seen quite a few companies that rushed to hire teams of people with a PhD in anything that barely made it through a DS/ML boot camp. To prove that they're super smart ML researchers without fail these hires rush to deploy a 3+ layer MLP to solve a problem that need at most a simple regression…

It's just a process of exploration, people trying out ideas to see what works. Over time, with sharing of results, we will gradually discover more nuanced approaches, but the exploration phase is necessary in order to map a path forward and train a generation of ML engineers and PM's who don't have seniors to learn from. Of course it sucks on the short term, but there is zero chance the field will be abandoned. It ha…

But the exploration should be led by the data scientists, not by the suits who think they need a specific type of model.

Re: Deep learning job postings have collapsed in the past six months

#254

According to data from Revealera.com, if you normalize the data, the % of job openings that mention 'deep learning' has actually remained stable YoY: https://i.imgur.com/sDoKwD0.png * Revealera.com crawls job openings from over 10,000 company websites and analyzes them for technology trends for hedge funds.

I think the fact the original tweet was not normalized in this incredibly obvious way is at least one valid reason companies could use less deep learning folk

I wouldn't expect anything different from François..

Re: Deep learning job postings have collapsed in the past six months

#255

I've been using voice commands on my android phone, in situations where I can't use my hands. Most often all I want to do is. 1. Start and stop a podcast. 2. Play music 3. Ask for the time The phone understands me, but then android breaks the flow, so I have to use my hands. 1. It will ask me to unlock the phone first? I have gloves and a mask on. It won't recognize my face, and my gloves don't register touches. Why…

I have similar with my Google Home; it can play Netflix but can't work out BBC iPlayer most of the time. And many times if I ask it to play music, it'll give an error saying it can't play on YouTube Music because I don't have a subscription, even though my default music player is Spotify in my account.

Re: Deep learning job postings have collapsed in the past six months

#256
post #84
post #61

Earlier quoted context omitted.

If you think about it, that's the natural outcome. Why? Because people in corporations don't have the incentive to benefit the business but to progress their careers and that's done through meeting the goals for their position and make their upper ups progress with their careers too. So essentially, you have a system where people spend other people's resources for living and their success is judged by making the chai…

>If you think about it, that's the natural outcome. Why? Because people in corporations don't have the incentive to benefit the business but to progress their careers and that's done through meeting the goals for their position and make their upper ups progress with their careers too. This is one of the reasons I roll my eyes whenever I read something like "McKinsey says 75% of Big Data/AI/Buzzword projects do not de…

Funny thing is, McKinsey consultants exactly knows why it fails, but won't say it because the responsibility falls on the execs that choose them for their reports or consulting. A paying customer should not have any reason to fear to regret choosing you as a consultant.

Re: Deep learning job postings have collapsed in the past six months

#257
post #211

Earlier quoted context omitted.

Or it could be that a lot of data is wrong. It may be "technically" correct, ie the table in a database produces X. It is no surprise that executives would ignore what the "data" says because they don't trust it. A lot of time they are right to ignore it. I've seen tables say X, but there was some flaw up the capture stack. Very few data analyst have the broad based knowledge and dedication needed to trace the data s…

Probably the biggest part of a lot of projects is cleaning up and normalizing the data (just like it was with data warehousing last century). A lot of high power data scientists don't want to hear that--especially if they're research-y.

If you don't at least tolerate data cleaning, you should find a different job than data scientist.

I would have expected the researchy people to be better at it, as often you'll need to collect and analyse your own data during grad programs, and thus have some experience.

Re: Deep learning job postings have collapsed in the past six months

#258

Earlier quoted context omitted.

I worked in a place full of deep learning PhDs, and you'd have people trying to apply reinforcement learning to problems that had known mathematical solutions, and integer programming problems. I don't think the issue is just that companies hire people who are awful at ML, it's also that people are trying to shoehorn deep learning into everything, even when it currently has nothing to offer and we have better solutio…

Unfortunately, this is where the incentives of the company and that of the employee diverges. For the employee, if they choose some simpler, appropriate model or solution to the problem, they will not be able to get that next DL job. Especially early in their career. I cannot bring myself to do resume driven development, but I understand why people do it.

But you probably don't need a DL job. As my dad always said, as long as you make them/save them money, they'll never fire you.

I know that I (as a DS Lead/Manager) would hire someone who uses an appropriate solution to a business problem above someone who has an intricate knowledge of applying PyTorch to inappropriate problems.

But maybe I'm in a minority here.

Re: Deep learning job postings have collapsed in the past six months

#259
post #61

Earlier quoted context omitted.

If you think about it, that's the natural outcome. Why? Because people in corporations don't have the incentive to benefit the business but to progress their careers and that's done through meeting the goals for their position and make their upper ups progress with their careers too. So essentially, you have a system where people spend other people's resources for living and their success is judged by making the chai…

> Because people in corporations don't have the incentive to benefit the business but to progress their careers AKA the principal-agent problem: https://en.wikipedia.org/wiki/Principal%E2%80%93agent_proble...

Putt's Law and Pournelle's iron law of bureaucracy also have pertinent (disastrous) effects. In the public sector they are even worse.

https://en.wikipedia.org/wiki/Putt%27s_Law_and_the_Successfu...

https://en.wikipedia.org/wiki/Jerry_Pournelle#Pournelle's_ir...

Re: Deep learning job postings have collapsed in the past six months

#260
I'm currently a masters student and I'm rather glad I opted not to take a specialized degree such as Machine Learning, taking on computer science instead. All this discussion about DS, ML, AI (and even CS) becoming over-saturated has made me rather wary and I worry that I'm choosing the wrong 'tracks' to study (currently doing ML and Cybersecurity as I genuinely am interested in those fields). I won't be graduating until next year but I'm forcing myself to be optimistic that the tech job market will be in a better place by then.
Post reply on HN