Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI Announces $10M Superalignment Grants

openai.com

Post reply on HN
Print view View original

11–20 of 61 posts

Re: OpenAI Announces $10M Superalignment Grants

#11

Post by voiceblue »

dumbo-octopus wrote: post #5
p1esk wrote: post #4

Earlier quoted context omitted.

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

> it can do anything a human can do. So it can get up and walk down the street? Not trying to be pedantic, but when one is defining things, one needs to be precise.

Indeed, and accepting that definition still fails to include extraterrestrial life. (The way that first sentence is written in TFA made me think of first contact).

Anyhow, it’s too late for “AGI” and “superintelligence”, aside from the baggage they also suffer from being in everyone’s domain to do with as they please. Precise terms inherently cannot be abused like this (compare “sore throat” to “acute viral laryngitis”).

Re: OpenAI Announces $10M Superalignment Grants

#12

Post by [deleted] »

bambax wrote: post #3

> This leads to the fundamental challenge: how can humans steer and trust AI systems much smarter than them? Our pets do this all the time. We're smarter than them (to a degree) yet they trust us absolutely, with their lives. Maybe our destiny is to be pets to machines.

[deleted]

Re: OpenAI Announces $10M Superalignment Grants

#13

Post by eastof »

p1esk wrote: post #4
voiceblue wrote: post #2

> We believe superintelligence could arrive within the next 10 years I'm not a fan of allowing corporations to control and define terms like AGI and superintelligence in ways that profit them, but perhaps it is our fault as a society for not producing stricter definitions of these terms. Seems to be a pervasive problem with terms in the sci-fi domain - we have 'hoverboards' these days, for example. Putting aside that…

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

Aren't those terms totally meaningless in terms of modern "AI" though? AGI is nowhere near being able to play a violin solo, their fine motor skills are abysmal. The list goes on and on, they also aren't running a bakery, collecting field data for ecological studies, or playing literally any sport any time soon either. The concept of a disembodied system even being "smart" doesn't make sense to me.

Re: OpenAI Announces $10M Superalignment Grants

#16

Post by dumbo-octopus »

p1esk wrote: post #7
dumbo-octopus wrote: post #5

Earlier quoted context omitted.

> it can do anything a human can do. So it can get up and walk down the street? Not trying to be pedantic, but when one is defining things, one needs to be precise.

Yes, when put in a robotic body.

Is the robotic body capable of metabolism, growth, and self-repair?

Re: OpenAI Announces $10M Superalignment Grants

#17

Post by cyanydeez »

voiceblue wrote: post #2

> We believe superintelligence could arrive within the next 10 years I'm not a fan of allowing corporations to control and define terms like AGI and superintelligence in ways that profit them, but perhaps it is our fault as a society for not producing stricter definitions of these terms. Seems to be a pervasive problem with terms in the sci-fi domain - we have 'hoverboards' these days, for example. Putting aside that…

almost all terms are mediated by American businesses in America.

Jay walking didn't exist until the car industry pushed for cars as the primary user of roads.

it takes a strong government to push back. Europe is doing that but America continues to bow to "line goes up" rhetoric.

Re: OpenAI Announces $10M Superalignment Grants

#18

Post by Baeocystin »

willmadden wrote: post #8

>We believe superintelligence could arrive within the next 10 years. Generating predictive output is not consciousness or superintelligence. I think the "superintelligence" talk is more of a ploy to scare the industry into regulatory capture. Remember, AI deeply threatens the existing business models of tech monopolies.

On it's own, I would agree with you. Put in to a feedback loop with some form of drive/motivation as a guide, though? I think at that point we'll firmly be in quacks like a duck territory. And I no longer think that is as far-fetched as I would have even a year ago.

Either way, I definitely agree with you on the regulatory capture angle.

Re: OpenAI Announces $10M Superalignment Grants

#19

Post by kweingar »

p1esk wrote: post #7
dumbo-octopus wrote: post #5

Earlier quoted context omitted.

> it can do anything a human can do. So it can get up and walk down the street? Not trying to be pedantic, but when one is defining things, one needs to be precise.

Yes, when put in a robotic body.

In this case, we are far from AGI
Post reply on HN