Live data from Hacker News

Deep learning job postings have collapsed in the past six months

twitter.com

231–240 of 274 posts

Re: Deep learning job postings have collapsed in the past six months

#231
post #61
post #43

Earlier quoted context omitted.

"Like Big Data, I think we'll see a few companies execute well and actually get some value, while most will just jump to the next shiny thing in a year or two." Here's another aspect - in many places nobody listens to the actual people doing the work. In my last job I was hired to lead a Data Science team and to help the company get value of Stats/ML/AI/DL/Buzzword. And I (and my team) were promptly overridden on eve…

If you think about it, that's the natural outcome. Why? Because people in corporations don't have the incentive to benefit the business but to progress their careers and that's done through meeting the goals for their position and make their upper ups progress with their careers too. So essentially, you have a system where people spend other people's resources for living and their success is judged by making the chai…

Anyone can sell the future.

Re: Deep learning job postings have collapsed in the past six months

#232

Earlier quoted context omitted.

I also witnesses this first hand at a Biotech company I worked at... we were using many variants of machine learning algorithms to develop predictive models of cell culture and separation processes. Problem is... the models have so many parameters in order to get a useful fit that the same model can also fit a carrot or an elephant. We found that dynamic parameter estimation on ODE/DAE/PDE system models, while harder…

Kind of weird that they would use ML/AI for a separations process. Separations and chemical engineering in general absolutely LOVES parameters and systems of equations. And don't go anywhere near colloids, those have so many empirically sourced parameters it will make your head spin.

You do this when you're a vendor working for big pharma and the people there can't/won't give you/don't understand the relevant quantities and aren't even familiar with standard models of the process despite their being formally trained chemical engineers and the models being 50 years old. Speaking from direct experience with several companies that are trying to bring us covid vaccines

Re: Deep learning job postings have collapsed in the past six months

#233

Earlier quoted context omitted.

Any sufficiently misunderstood algorithm is indistinguishable from AI.

Ha! I'm going to have to borrow this phrase.

I think it's a play on "Any sufficiently advanced technology is indistinguishable from magic".

Re: Deep learning job postings have collapsed in the past six months

#234
I don't think anyone should freak out when they see a tweet like this: deep learning is just one particularly trendy part of ML, which is just one piece of data science, which is just one job title in the "working with data" career space. I think that most people with backgrounds or interests in DL are very well equipped to participate in the (ever more important) data science world.

Re: Deep learning job postings have collapsed in the past six months

#236
post #28

I've worked in lots of big corps as a consultant. Every one raced to harness the power of "big data" ~7 years ago. They couldn't hire or spend money fast enough. And for their investment they (mostly) got nothing. The few that managed to bludgeon their map/reduce clusters in to submission and get actionable insights discovered... they paid more to get those insights than they were worth! I think this same thing is ha…

ML is a shiny object with often no discernible ROI but occasionally very large ROI, and companies are understandably nervous about missing out. Spending a small amount to hedge their bets isn't necessarily irrational.

Re: Deep learning job postings have collapsed in the past six months

#237
post #91

Earlier quoted context omitted.

Everyone wants to fire up Tensorflow, Keras and PyTorch these days. Fewer people want to work in Airflow and SSIS, spend days tuning ETL, etc. This is the domain of data engineering, which bridges software engineering and data science with a dash of devops. I’ve been working in this field for a couple of years and it’s clear to me that data engineering is a necessary foundation and impact multiplier for data science.

Don't forget data cleaning. A huge issue I've seen is just getting sufficient data of a high enough quality. Also, (for supervised classification problems) labelling is a big problem. It is almost as if we need a "data janitor" title.

As a data engineer I've often billed myself as the Charlie Kelly of data

Re: Deep learning job postings have collapsed in the past six months

#238
post #177

Earlier quoted context omitted.

In my AI class in college, we learned about first order logic. To me it didn't seem like we were really learning AI but I couldn't quite put my finger on it. I guess it's because it made too much sense so in my mind it couldn't be AI.

This is basically a form of the AI effect[1]: > The AI effect occurs when onlookers discount the behavior of an artificial intelligence program by arguing that it is not real intelligence. [1]: https://en.wikipedia.org/wiki/AI_effect

Ah yes, the AI version of the no true scotsman fallacy

Re: Deep learning job postings have collapsed in the past six months

#239
post #43
post #28

I've worked in lots of big corps as a consultant. Every one raced to harness the power of "big data" ~7 years ago. They couldn't hire or spend money fast enough. And for their investment they (mostly) got nothing. The few that managed to bludgeon their map/reduce clusters in to submission and get actionable insights discovered... they paid more to get those insights than they were worth! I think this same thing is ha…

"Like Big Data, I think we'll see a few companies execute well and actually get some value, while most will just jump to the next shiny thing in a year or two." Here's another aspect - in many places nobody listens to the actual people doing the work. In my last job I was hired to lead a Data Science team and to help the company get value of Stats/ML/AI/DL/Buzzword. And I (and my team) were promptly overridden on eve…

I did data a decade ago at a school district. A more experienced mentor at another school district let me in on a secret that is true across all industries no matter the size or type.

If you give executives data and they don't like the results, they will ask you to tweak parameters until the data represents what they want.

Re: Deep learning job postings have collapsed in the past six months

#240
post #18

Earlier quoted context omitted.

Why not? I would have thought it was a buyer’s market now with all the layoffs.

There's tons of layoffs because businesses are doing really badly . Current cashflow may not support another developer. Future cashflow doesn't look that great in any B2C market, either, and the B2B markets will start to look slim pickings not too far after that.

I’m not sure I follow. My question was directed toward OP, whose company is hiring, which presumably means they are doing well. Can you please clarify?
Post reply on HN