Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The Machine Learning Job Market

evjang.com

Post reply on HN
Print view View original

181–190 of 276 posts

Re: The Machine Learning Job Market

#181

Post by captaincaveman »

throwaway889900 wrote: post #108
TigeriusKirk wrote: post #85

Off topic a bit - "Halodi Robotics (company he's joining) intends to produce thousands of humanoid robots by 2023" Are humanoid robots just around the corner? Musk claims Tesla will have a "prototype" humanoid robot this year. I dismissed that as Elon hype, but have I missed this coming?

The only thing you need for a humanoid robot is for it to be human shaped and have some electronics inside of it. Doesn't mean it has to even remotely be human in interaction.

The robots on their site look pretty clunky to me, not to say they aren't doing smart things.

Re: The Machine Learning Job Market

#182

Post by marginalia_nu »

water-your-self wrote: post #162
mysterEFrank wrote: post #146

Earlier quoted context omitted.

Eric Jang is top ML talent, these numbers are accurate. I work in ML and have followed his work for years

He claims to be solving general intelligence in 20 years. Your advocacy is not enough to convince me.

General intelligence has been 20 years away since the 60s, along with fusion power and a bunch of other things.

In marketing, they say 5 years when it's actually 20 years away.

Re: The Machine Learning Job Market

#183

Post by fxtentacle »

rychco wrote: post #65
awinter-py wrote: post #10

> The most important deciding factor for me was whether the company has some kind of technological edge years ahead of its competitors. A friend on Google’s logging team tells me he’s not interested in smaller companies because they are so technologically far behind Google’s planetary-scale infra that they haven’t even begun to fathom the problems that Google is solving now, much less finish solving the problems that…

This has become increasingly important to me too. I am employed by a small (2-4 engineers at any time) company and I'm often disappointed because we're just so far behind in manpower & technical expertise that we have to dramatically reduce the scope of any problem we want to tackle. On the other hand, I also worry about getting sucked into the bureaucracy of FAANG sized companies & not having any accountability or a…

I'm surprised. Apart from DALLE, I haven't seen any AI approach that's off limits for 4 highly motivated people with 3090 GPUs.

At that compute level, you should be able to at least replicate SOTA in optical flow, structure from motion, speech recognition, text to speech, translation, text summary, sentiment analysis, image classifications, image segmentation, and of course playing video games or optimizing processes with reinforcement learning.

I mean thanks to KiCad even custom sensor hardware is cheap these days.

Can you give more details about what you tried to do and why that wasn't possible?

Re: The Machine Learning Job Market

#184

Post by visarga »

water-your-self wrote: post #161
visarga wrote: post #132

Earlier quoted context omitted.

> The glorified pattern matching can only take us so far. This argument is becoming less and less convincing year by the year. We're amazed that things we were sure couldn't be done are actually done.

This argument has been on going, on and off, since the 1960s. Show me a research paper.

1960s were 60 years ago, we're talking about AI, a fast paced field in the last 15 years.

Re: The Machine Learning Job Market

#185

Post by going_ham »

ChefboyOG wrote: post #134
samhw wrote: post #84

Earlier quoted context omitted.

> The innovation in AI really seems like it is being made on a thin line of engineering and compute. This perfectly echoes my own thoughts. The advances being trumpeted in AI are functions of hardware advances that allow us to have massively overparameterised models, models which essentially 'make the map the size of the territory'[0], which is why they only succeed at a narrow class of interpolation problems. And ev…

Eh, if you boil all research in AI/ML down to the binary of "AGI or bust," then sure, everything is a failure. But, if you look at your smartphone, virtually every popular application the average person uses--Gmail, Uber, Instagram, TikTok, Siri/Google Assistant, Netflix, your camera, and more--all owe huge pieces of their functionality to ML that's only become feasible in the last decade because of the research you'…

These are engineering marvel! This is engineering at it's finest. Applied math at it's finest. So it's not a failure.

The way people hype AGI/AI/ML whatever undervalues the actual effort behind these remarkable feat. There is so much effort being made to make this work. Deep learning works when it is engineered properly. So it is just another tool in the toolbox!

Look at how graphics community is approaching deep learning. They already had sampling methods but with MLPs (NeRFs), they are using it as glorified database. So it's engineering!

I want to underscore that AI/ML/DL research requires ground breaking innovation not only in algorithms but also in hardware and software engineering.

Re: The Machine Learning Job Market

#186

Post by fxtentacle »

going_ham wrote: post #71

This post feels like author is insecure about his position and wants to establish some validity. Having going through it all, it feels delusional at best. The glorified pattern matching can only take us so far. You know it's working as long as there is a pattern. I wouldn't call it a general intelligence per se. There is no "juice" in these algorithms. If we use these tools, we can immediately see where they fail and…

Pattern matching can solve everything, if given enough storage and training data. Memorizing trillions of sentences is basically what makes GPT3 amazing.

You're absolutely correct that patten matching AIs won't ever be truly intelligent. But then again, many humans also never exceed what can be simulated with good pattern matching. And an AGI household robot only needs to be as smart as the maid that it's replacing.

I'm optimistic that pure pattern matching will get us to usable AGI AI.

Re: The Machine Learning Job Market

#187

Post by fartcannon »

zcw100 wrote: post #152

After how many years of Facebook, instagram, youtubers, LinkedIn do people still not get it? This is the internet. How on earth can you verify the veracity of the authors statements? Everyone is discussing this like a blog post on themselves is an accurate portrayal of reality. It might be, but it might not. I'm not saying they're being dishonest, with they may be, but they are definitely not incentivized to give you…

To me, outside of this world, it feels like when one of the guys at a shop just like ours wins the lottery a few cities over. Everyone's just dreaming big for the fun of it.

Re: The Machine Learning Job Market

#188

Post by going_ham »

visarga wrote: post #184
water-your-self wrote: post #161

Earlier quoted context omitted.

This argument has been on going, on and off, since the 1960s. Show me a research paper.

1960s were 60 years ago, we're talking about AI, a fast paced field in the last 15 years.

Definitely! There was a time when compilers were part of AI research. Now they are just another tool. Same with DL, they are amazing tool. We need them and they provide value if used correctly.

I just didn't want to call it as "intelligent" and use this as basis for defining "intelligence." We can call them something else. It's learning to do a specialized job as intended and in "intelligent" manner. But it is not intelligence. Even a small ant is intelligent than our current AI systems though they aren't sophisticated and can't perform human task, they are intelligent than AI system.

I hope that made sense.

Re: The Machine Learning Job Market

#189

Post by joe_the_user »

fxtentacle wrote: post #186
going_ham wrote: post #71

This post feels like author is insecure about his position and wants to establish some validity. Having going through it all, it feels delusional at best. The glorified pattern matching can only take us so far. You know it's working as long as there is a pattern. I wouldn't call it a general intelligence per se. There is no "juice" in these algorithms. If we use these tools, we can immediately see where they fail and…

Pattern matching can solve everything, if given enough storage and training data. Memorizing trillions of sentences is basically what makes GPT3 amazing. You're absolutely correct that patten matching AIs won't ever be truly intelligent. But then again, many humans also never exceed what can be simulated with good pattern matching. And an AGI household robot only needs to be as smart as the maid that it's replacing.…

Pattern matching can solve everything, if given enough storage and training data.

There's never going to be training data for "how things are going to be next year". A lot of large scale systems involve emergence [1], patterns which previously were not visible suddenly appearing. I think even today's AI can do things that a bit beyond pattern matching (learning to learn, etc). But pure matching as such is inherently limited.

[1] https://en.wikipedia.org/wiki/Emergence

Re: The Machine Learning Job Market

#190

Post by 21723 »

axg11 wrote: post #94
oneoff786 wrote: post #17

Earlier quoted context omitted.

On the other hand, there’s a lot of real problems that real people actually deal with that just need a logistic regression to save million bucks here and there. I like that space more.

This describes 95% of machine learning at FAANG+, unfortunately nobody likes to talk about. Context: I work at a FAANG.

Probably 99%. The people doing next-level stuff are largely being humored so the FAANGs can hire more early 20s grunts who think they're going to be working on ML (they won't be) or even given the time of day by leads on such projects (ditto). You give some famous professor a high-6 or low-7 figure salary in a position where his job is to publish papers--or not, because no one who matters in the company will ever read them--but you get incrementally more effort out of the youngsters who think they've got a chance (and they don't) of working on something more exciting than Jira tickets.

I don't think the FAANGs will ever come up with AGI and I am glad for that. If the private sector gets there first, I am going to "accidentally" die of hypothermia on a hiking trip because I will do anything not to live in their world.

Post reply on HN