Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Sequence to sequence learning with neural networks: what a decade

youtube.com

Post reply on HN
Print view View original

11–20 of 34 posts

Re: Sequence to sequence learning with neural networks: what a decade

#11

Post by someothherguyy »

nopinsight wrote: post #9
AceJohnny2 wrote: post #7

Earlier quoted context omitted.

> Thus, the future will be unpredictable (if we let superintelligence take control) As opposed to the predictable future we've had for the past few decades?

I think it's a matter of magnitude and semantics. It was quite predictable that the Internet would take off, become ubiquitous, and highly influential. If superintelligence emerges soon, we may not even know which technologies will emerge and how many will be unleashed in the next 2 decades. ADDED: Examples of some concrete predictions: (1980) https://en.wikipedia.org/wiki/The_Third_Wave_(Toffler_book) (1995) https:/…

Wouldn't base economics dictate that, not ASI? A state can have knowledge of how to do things, how things work, hypothetical implementations, etc. However, if a state lacks the resources, skill, or desire to actually confirm and implement those hypothetical technologies, would they just stagnate? There might be a bottleneck there?

Re: Sequence to sequence learning with neural networks: what a decade

#12

Post by jb1991 »

nopinsight wrote: post #9
AceJohnny2 wrote: post #7

Earlier quoted context omitted.

> Thus, the future will be unpredictable (if we let superintelligence take control) As opposed to the predictable future we've had for the past few decades?

I think it's a matter of magnitude and semantics. It was quite predictable that the Internet would take off, become ubiquitous, and highly influential. If superintelligence emerges soon, we may not even know which technologies will emerge and how many will be unleashed in the next 2 decades. ADDED: Examples of some concrete predictions: (1980) https://en.wikipedia.org/wiki/The_Third_Wave_(Toffler_book) (1995) https:/…

Hindsight.

Re: Sequence to sequence learning with neural networks: what a decade

#13

Post by nwienert »

nopinsight wrote: post #6

An important point from this talk: The better the models are at reasoning, the less predictable they become. This is analogous to top chess engines which make surprising moves that even human super grandmasters can't always understand. Thus, the future will be unpredictable (if superintelligence takes control). Link to the full talk & the time he talks about this: https://youtu.be/1yvBqasHLZs?si=3M6eZCQtXnW2tSUd&t=86…

I don’t think that’s broadly true with chess. Did you mean go?

Re: Sequence to sequence learning with neural networks: what a decade

#15

Post by nopinsight »

someothherguyy wrote: post #11
nopinsight wrote: post #9

Earlier quoted context omitted.

I think it's a matter of magnitude and semantics. It was quite predictable that the Internet would take off, become ubiquitous, and highly influential. If superintelligence emerges soon, we may not even know which technologies will emerge and how many will be unleashed in the next 2 decades. ADDED: Examples of some concrete predictions: (1980) https://en.wikipedia.org/wiki/The_Third_Wave_(Toffler_book) (1995) https:/…

Wouldn't base economics dictate that, not ASI? A state can have knowledge of how to do things, how things work, hypothetical implementations, etc. However, if a state lacks the resources, skill, or desire to actually confirm and implement those hypothetical technologies, would they just stagnate? There might be a bottleneck there?

Resources will surely impact near-term possibilities.

The space of possibilities is probably large enough that, given time, ASI can get around most limitations if it has the desire/goal to implement them.

Re: Sequence to sequence learning with neural networks: what a decade

#17

Post by sdenton4 »

nopinsight wrote: post #15
someothherguyy wrote: post #11

Earlier quoted context omitted.

Wouldn't base economics dictate that, not ASI? A state can have knowledge of how to do things, how things work, hypothetical implementations, etc. However, if a state lacks the resources, skill, or desire to actually confirm and implement those hypothetical technologies, would they just stagnate? There might be a bottleneck there?

Resources will surely impact near-term possibilities. The space of possibilities is probably large enough that, given time, ASI can get around most limitations if it has the desire/goal to implement them.

Well, that's wishful thinking at best...

There's a lot of things that we know how to fix, but cannot. It's with thinking through why that is, and whether it's any different for a 'superintelligence.'

Re: Sequence to sequence learning with neural networks: what a decade

#18

Post by rented_mule »

nopinsight wrote: post #6

An important point from this talk: The better the models are at reasoning, the less predictable they become. This is analogous to top chess engines which make surprising moves that even human super grandmasters can't always understand. Thus, the future will be unpredictable (if superintelligence takes control). Link to the full talk & the time he talks about this: https://youtu.be/1yvBqasHLZs?si=3M6eZCQtXnW2tSUd&t=86…

I think there is an analogous challenge to the gradual, but large scale adoption of self-driving cars. Even in the absence of reasoning, they have different constraints than human drivers. This makes them react to situations in ways that surprise human drivers around them. It's not hard to imagine that being a new source of accidents.

It won't just be a matter of learning how they react differently, because it will be different from one self-driving platform to another. Sometimes even from one version of a platform to another. And is self-driving engaged, or is the human in control at the moment? Or is self-driving in the process of abdicating to the human, making behavior different from what it was a moment ago?

Re: Sequence to sequence learning with neural networks: what a decade

#19

Post by nopinsight »

sdenton4 wrote: post #17
nopinsight wrote: post #15

Earlier quoted context omitted.

Resources will surely impact near-term possibilities. The space of possibilities is probably large enough that, given time, ASI can get around most limitations if it has the desire/goal to implement them.

Well, that's wishful thinking at best... There's a lot of things that we know how to fix, but cannot. It's with thinking through why that is, and whether it's any different for a 'superintelligence.'

> There's a lot of things that we know how to fix, but cannot.

This assumes that humanity would remain in control after ASI emerges. We might not.

Post reply on HN