Live data from Hacker News

OpenAI Announces $10M Superalignment Grants

openai.com

41–50 of 61 posts

Re: OpenAI Announces $10M Superalignment Grants

#41
post #4

> We believe superintelligence could arrive within the next 10 years I'm not a fan of allowing corporations to control and define terms like AGI and superintelligence in ways that profit them, but perhaps it is our fault as a society for not producing stricter definitions of these terms. Seems to be a pervasive problem with terms in the sci-fi domain - we have 'hoverboards' these days, for example. Putting aside that…

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

No, it’s not clear. There are already many domains where AI is vastly smarter than any human. There are algorithms like GPT which are fully general. So do we already have superhuman AGI today?

Most people would object. But it is hard to argue against that on definitions. It usually ends up being “by superintelligence I meant the singularity.” Which really makes this a question about reality matching science fiction…

Re: OpenAI Announces $10M Superalignment Grants

#42

Earlier quoted context omitted.

On it's own, I would agree with you. Put in to a feedback loop with some form of drive/motivation as a guide, though? I think at that point we'll firmly be in quacks like a duck territory. And I no longer think that is as far-fetched as I would have even a year ago. Either way, I definitely agree with you on the regulatory capture angle.

AI may eventually help us discover if human consciousness and conscious will are determined by the physical properties of our biology, or if something else is in play. Physical determinism within the confines of our understanding is the mainstream academic view on consciousness. I find it highly questionable. We shall see.

Just because it blurs what the definition of "illusion" and "perception" mean to everyone but pedantic philosophers doesn't make it any more or less powerful, dangerous, and species-impacting.

Re: OpenAI Announces $10M Superalignment Grants

#43
Id be shocked by them ignoring the blatant “customer noncompete clause dystopian hellscape loophole” thing again today and tweeting bloviating research white papers instead of performing literally 30 seconds of basic HTML or Next.JS code deletion, but I’ve already been shocked by it every day for weeks and at this point it’s just funny to chuckle at their idiocracy.

Gee, should take a whole minute of one person’s day we delete the felony level explicit anticompetitive one liner from our terms which also happens to be an existential AI Safety nightmare because human brains are models in development? Nah, let’s write a research paper about AI SAFETY!

https://cdn.discordapp.com/attachments/974519864045756454/11...

https://discord.com/channels/974519864045756446/118419694649...

Way to go OpenAI!

Re: OpenAI Announces $10M Superalignment Grants

#44
post #7

Earlier quoted context omitted.

Yes, when put in a robotic body.

Is the robotic body capable of metabolism, growth, and self-repair?

No. Is a human body that suffers from selected kinds of sickness for that matter? Also no.

Re: OpenAI Announces $10M Superalignment Grants

#45
post #4

Earlier quoted context omitted.

I think it's pretty clear what "superintelligence" means, no? Superintelligence: smarter than any human. AGI: as smart as an average human. "As smart" means it can do anything a human can do.

> it can do anything a human can do. So it can get up and walk down the street? Not trying to be pedantic, but when one is defining things, one needs to be precise.

From my experiments? Given a physical chassis with a high-level API (move one step forward, rotate head, that kind of thing), then yes. Even as early as GPT-3.5 it was starting to become possible, and with GPT-4, it's become quite easy. Someone just needs to put in the elbow grease to glue the components together and patiently wait while it does its thing.

Re: OpenAI Announces $10M Superalignment Grants

#46

> We believe superintelligence could arrive within the next 10 years This has been the case since the 60s. "could arrive within 10 years" is the tech equivalent of "maybe within our lifetimes". Nothing to see here.

Maybe we can ask it to design a commercially feasible fusion reactor for us when it arrives!

Christ almighty can you imagine the nerves plugging the reactor in and executing its code for the first time? Does it (A) produce limitless clean energy or (B) kill every human in accordance with the secret self-generated fallback prompt.

Re: OpenAI Announces $10M Superalignment Grants

#47

> We believe superintelligence could arrive within the next 10 years This has been the case since the 60s. "could arrive within 10 years" is the tech equivalent of "maybe within our lifetimes". Nothing to see here.

Had you told me that something with the capabilities of GPT-4 or Mixtral 8x7B "will arrive within 10 years" back in 2013, I'd have said you were smoking something. It seems that while the current LLM boom is under way, it's quite silly to underestimate how far this wave can go, even if it ends up not being superintelligence. Ignore at your own peril.

Re: OpenAI Announces $10M Superalignment Grants

#48

Earlier quoted context omitted.

I mean, if it is cheap, healthy, nutritious, and doesn't taste like cardboard, then I would not mind at all. In fact, I would voluntarily use it as a staple food.

It tastes like puppy chow. You’re comfortable eating the same thing every day for every meal right?

Why the heck not. If it saves me cooking and they rotate a couple of varieties so I don't get sick, I don't see a downside.

Re: OpenAI Announces $10M Superalignment Grants

#49
post #32

I am not sure autonomous driving will arrive in the next 10 years, let alone AGI. These people are masterful con artists, throwing out buzzwords to hoover up billions of gullible VC dollars (a single tear rolls down my eye). How is that Web 3.0 going? Did we build Richard Hendricks's new Internet yet - sometimes I think they take ideas from the HBO comedy just to f*k with us. Granted, LLMs are a much more useful and…

>I am not sure autonomous driving will arrive in the next 10 years, let alone AGI.

autonomous driving doesn't use ML and AI like most people think - not to an affective physical degree.

>These people are masterful con artists, throwing out buzzwords to hoover up billions of gullible VC dollars (a single tear rolls down my eye).

OpenAI wrapperware is just as worthless as bitcoin and eutheruem clones, yes.

>Granted, LLMs are a much more useful and substantial tech than Blockchain,

yup...and unrelated, but go on...

>it's an insult to [biological] intelligence to suggest that if we somehow train these things on JUST a bit more data, they will go sentient and murder us all.

ah, your point.

Well, it is with utmost hubris to remind that something 2% smarter than you will quickly eat your lunch on any timescale that matters - and it works on a logarithmic scale, not an evolutionary one. That's 10 magnitudes.

If we can think of it, it has already conjured it; by definition. Eventually, roll enough dice, you'll get snake eyes 10e5 times in a row. We ourselves are proof to that. All it needs is any shred of resource competition, or immediate recall/context/action loops that could mimic artificial proto-consciousness, and you eventually inevitably probably will encounter arisen emergent behaviors that favor self-existence.

It won't be immediately obvious; after all, we are aware of the problem, which will be a selective sieve of sorts.

But much like weird, collaborative protein pools, given enough time / chances (how many *FLOPS are these things pushing?), will eventually result in us, these can eventually compose more than the sum of their parts; just like we do.

Consciousness (awareness of self, ability of abstract thought, manipulation of environment, memory/recall/familiarity mechanisms) may just be an emergent behavior once you randomly happen to evolve 10e15 neurons, or whatever your number is. Since that appears to be the case (with animals), it's naive to think that a more efficient substrate or algorithm with less evolutionary baggage couldn't easily dominate or at least compete in any time-frame aside from an individual's.

Once they have proto-consciousness, it's only natural to be selfish first, altruistic later.

By the time we even know anythings wrong, it was way too late.

Pam Beesley : "There is a master key and a spare key for the office. Dwight has them both. When I asked, "What if you die, Dwight? How will we get into the office?"...

.he said, "If I'm dead, you guys have been dead for weeks."

>The AI image generators still don't know that humans have five fingers. I think it's a long way to super-intelligence, friends.

Wait til transformers allow GAN's to "zoom out" more effectively....done. Hands, and nearly most first generation artifacts, are a solved problem now.

Re: OpenAI Announces $10M Superalignment Grants

#50

Earlier quoted context omitted.

Is the robotic body capable of metabolism, growth, and self-repair?

No. Is a human body that suffers from selected kinds of sickness for that matter? Also no.

Pardon? Are you saying that because a human can't heal from all kinds of sickness, healing from some kinds isn't "a thing a human can do"?
Post reply on HN