Live data from Hacker News

A Year at Google Brain (2020)

debugmind.com

21–30 of 105 posts

Re: A Year at Google Brain (2020)

#21
> I suspect that convex optimization has the potential to become a powerful, widely-used technology.

I would say it has achieved that status already :)

Deep learning is getting more than its share of hype. Convex optimization is a jewel of computational science.

Re: A Year at Google Brain (2020)

#23
post #9

Earlier quoted context omitted.

I'm now in my third year of my PhD and enjoying it more than ever, so there's that at least! In all seriousness, I totally acknowledge that the variance in satisfaction with a PhD is very large. I'm lucky to have a great advisor and incredible labmates; my happiness with the program is largely due to them.

> I'm lucky to have a great advisor and incredible labmates; my happiness with the program is largely due to them. This. So much this. As in just about every profession, people make or break places. Your advisor and lab mates are everything... choose wisely, and choose them vs a school for its name.

As others have noted, it can be harder to move around academia than in industry. Your immediate community matters a lot more, whether you're a PhD student, a postdoc, or faculty. When things work it's great; when they don't, it's correspondingly worse.

Re: A Year at Google Brain (2020)

#24

> I’m not convinced that today’s AI is anywhere near as profound as electricity or fire @akshayka can you elaborate a bit more on why you think that

Modern ML certainly has some cool applications, but none seem revolutionary. Can you list any that are?

Off the top of my head:

When paired with a robotic medium, we'll be able to automate most pattern driven jobs like construction, welding, surgery, anything really that doesn't require human element to it and is more of a pattern matching behavior.

This is extremely revolutionary and will put a ton of people out of work. Any pattern-dependent job that does not require human interaction will be at risk, even coding (as we've seen by GPT-3's ability to generate code). Lawyers, sales people, cops, these jobs will be ok, but there will be less demand for humongous medical teams, software teams, etc. Bc all the entry-level work can be handled by AI, and just need some QA from a few engineers.

Re: A Year at Google Brain (2020)

#25
Of particular note:

"Google’s CEO Sundar Pichai (who believes AI is “more profound than electricity or fire”) has emphasized that Google is an “AI-first” company, with the company seeking to implement machine learning in nearly everything do"

Nearly everything they do with your data.

Re: A Year at Google Brain (2020)

#26

> While I’m interested in machine learning, I’m not convinced that today’s AI is anywhere near as profound as electricity or fire This seems a not too uncommon experience among CS people where machine learning loses its interest once they understand the magic

In 1850, few people felt that electricity was particularly profound either. That year, William Gladstone, Chancellor of the Exchequer, asked Michael Faraday why electricity was valuable. Faraday replied, "One day sir, you may tax it." [1].

The electric motor had been invented (by Faraday), but it couldn't do any useful work and had to sit in a pool of mercury to function. Electric lighting had been invented, but the filaments were dim and burned out too quickly to be practical. There was no way to generate or distribute electricity at scale. To most people, electricity looked like a toy (and a terrifying toy at that). It would take decades of invention and refinement to get to the point where electricity was useful, reliable, and ubiquitous. But the seeds for doing so were there in 1850.

So when Sundar Pichai says AI is more profound than electricity, it's possible he's right. It's just that we're still in its 1850, so we can't see it yet.

[1] https://en.wikipedia.org/wiki/Electricity#Cultural_perceptio...

Re: A Year at Google Brain (2020)

#27
post #26

> While I’m interested in machine learning, I’m not convinced that today’s AI is anywhere near as profound as electricity or fire This seems a not too uncommon experience among CS people where machine learning loses its interest once they understand the magic

In 1850, few people felt that electricity was particularly profound either. That year, William Gladstone, Chancellor of the Exchequer, asked Michael Faraday why electricity was valuable. Faraday replied, "One day sir, you may tax it." [1]. The electric motor had been invented (by Faraday), but it couldn't do any useful work and had to sit in a pool of mercury to function. Electric lighting had been invented, but the…

There are almost seven times as many people alive today as there were in 1850 -- we may be in 1850, but the number of clever people driving advances is substantially larger.

Re: A Year at Google Brain (2020)

#28

Earlier quoted context omitted.

Modern ML certainly has some cool applications, but none seem revolutionary. Can you list any that are?

Off the top of my head: When paired with a robotic medium, we'll be able to automate most pattern driven jobs like construction, welding, surgery, anything really that doesn't require human element to it and is more of a pattern matching behavior. This is extremely revolutionary and will put a ton of people out of work. Any pattern-dependent job that does not require human interaction will be at risk, even coding (as…

This is a wildly optimistic take on what AI can accomplish, and a misunderstanding of the difficulties in all those tasks. If AI can do the first set of jobs, it will be able to replace sales people, cops, and lawyers too. But there's nothing, yet, to indicate that there isn't a wide gulf between the current state of the art and the kind of generalized intelligence you're talking about.

Re: A Year at Google Brain (2020)

#29

Earlier quoted context omitted.

Modern ML certainly has some cool applications, but none seem revolutionary. Can you list any that are?

Off the top of my head: When paired with a robotic medium, we'll be able to automate most pattern driven jobs like construction, welding, surgery, anything really that doesn't require human element to it and is more of a pattern matching behavior. This is extremely revolutionary and will put a ton of people out of work. Any pattern-dependent job that does not require human interaction will be at risk, even coding (as…

All that from today's AI? The best I've seen from today's AI is a few gpt-3 articles that are clearly in the uncanny valley and a car which may or may not mistake an exit ramp wall for a passing lane.

Re: A Year at Google Brain (2020)

#30

I have nothing of value to add except that seeing someone do what they love and enjoy, greatly warms my heart. Good luck with everything Akshay!!

Really? If anything it makes me really angry. I generally despise seeing people happy, especially people that have gotten everything in life (as someone that has definitely not).

What an interesting way to view the world...

Post reply on HN