Live data from Hacker News

OpenAI Announces $10M Superalignment Grants

openai.com

1–10 of 61 posts

Re: OpenAI Announces $10M Superalignment Grants

#2
> We believe superintelligence could arrive within the next 10 years

I'm not a fan of allowing corporations to control and define terms like AGI and superintelligence in ways that profit them, but perhaps it is our fault as a society for not producing stricter definitions of these terms. Seems to be a pervasive problem with terms in the sci-fi domain - we have 'hoverboards' these days, for example.

Putting aside that lament, I wonder if we're heading towards another iteration of learning the bitter lesson [0]. It seems that the incentives presented here are trying to circumvent approaches that overly favor human oversight, but they still seem to overly emphasize human understanding.

[0] http://www.incompleteideas.net/IncIdeas/BitterLesson.html

Re: OpenAI Announces $10M Superalignment Grants

#3
> This leads to the fundamental challenge: how can humans steer and trust AI systems much smarter than them?

Our pets do this all the time. We're smarter than them (to a degree) yet they trust us absolutely, with their lives.

Maybe our destiny is to be pets to machines.

Re: OpenAI Announces $10M Superalignment Grants

#4

> We believe superintelligence could arrive within the next 10 years I'm not a fan of allowing corporations to control and define terms like AGI and superintelligence in ways that profit them, but perhaps it is our fault as a society for not producing stricter definitions of these terms. Seems to be a pervasive problem with terms in the sci-fi domain - we have 'hoverboards' these days, for example. Putting aside that…

I think it's pretty clear what "superintelligence" means, no?

Superintelligence: smarter than any human. AGI: as smart as an average human.

"As smart" means it can do anything a human can do.

Re: OpenAI Announces $10M Superalignment Grants

#5
post #4

> We believe superintelligence could arrive within the next 10 years I'm not a fan of allowing corporations to control and define terms like AGI and superintelligence in ways that profit them, but perhaps it is our fault as a society for not producing stricter definitions of these terms. Seems to be a pervasive problem with terms in the sci-fi domain - we have 'hoverboards' these days, for example. Putting aside that…

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

> it can do anything a human can do.

So it can get up and walk down the street?

Not trying to be pedantic, but when one is defining things, one needs to be precise.

Re: OpenAI Announces $10M Superalignment Grants

#6
post #4

> We believe superintelligence could arrive within the next 10 years I'm not a fan of allowing corporations to control and define terms like AGI and superintelligence in ways that profit them, but perhaps it is our fault as a society for not producing stricter definitions of these terms. Seems to be a pervasive problem with terms in the sci-fi domain - we have 'hoverboards' these days, for example. Putting aside that…

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

You just defined the word with the same word -- which is what everyone seems to do.

Smarter how? Where? Computers are already smarter at math, physics, simulation, etc than humans

Generalized smarter? At what? Emotional intelligence? Self preservation? on and on

Re: OpenAI Announces $10M Superalignment Grants

#7
post #4

Earlier quoted context omitted.

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

> it can do anything a human can do. So it can get up and walk down the street? Not trying to be pedantic, but when one is defining things, one needs to be precise.

Yes, when put in a robotic body.

Re: OpenAI Announces $10M Superalignment Grants

#8
>We believe superintelligence could arrive within the next 10 years.

Generating predictive output is not consciousness or superintelligence. I think the "superintelligence" talk is more of a ploy to scare the industry into regulatory capture. Remember, AI deeply threatens the existing business models of tech monopolies.

Re: OpenAI Announces $10M Superalignment Grants

#9
post #4

Earlier quoted context omitted.

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

> it can do anything a human can do. So it can get up and walk down the street? Not trying to be pedantic, but when one is defining things, one needs to be precise.

Is it has a mean of locomotion, yes.

Re: OpenAI Announces $10M Superalignment Grants

#10
post #4

Earlier quoted context omitted.

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

You just defined the word with the same word -- which is what everyone seems to do. Smarter how? Where? Computers are already smarter at math, physics, simulation, etc than humans Generalized smarter? At what? Emotional intelligence? Self preservation? on and on

I mean "smart" in exactly the same way you would use the word when talking about people: "John is smarter than Paul". Or "an average college professor is smarter than an average college student". People use this word assuming others understand what it means. That's my assumption as well.
Post reply on HN