Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

Post reply on HN
Print view View original

121–130 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#121

Post by goodluckchuck »

ignoramous wrote: post #80
qgin wrote: post #64

There will come a day when 50% of jobs are being done by AI, major decisions are being made by AI, we're all riding around in cars driven by AI, people are having romantic relationships with AI... and we'll STILL be debating whether what has been created is really AGI. AGI will forever be the next threshold, then the next, then the next until one day we'll realize that we passed the line years before.

> we're all riding around in cars driven by AI, people are having romantic relationships with AI... ASI (domain-specific superintelligence) and AGI (general intelligence) are different things. ASI already exists in multiple forms, AGI doesn't.

> AGI doesn't

AGI hasn’t been publicly demonstrated and made available to the masses… but it may exist secretly in one or more labs. It may even be being used in the field under pseudonyms, informing decisions, etc.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#122

Post by Mountain_Skies »

gadders wrote: post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

Wouldn't be the first time someone leaked the truth to 4chan only to have the posters there lambast the leaker as an attention seeker spreading false information.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#123

Post by chii »

TheOtherHobbes wrote: post #86
cdsfcvv wrote: post #41

Earlier quoted context omitted.

I don’t understand this sentiment. Aren’t consumers doing the burning?

I'd like to have the choice not to. I have extremely limited options for that. And I already live in a country which regularly has all of its electricity generated renewably.

> I'd like to have the choice not to.

your choice can't be outcome based. i.e., you can't want to choose an option where you obtain the same electricity and energy and comforts, but with no pollution and with the same cost. Because such a choice never existed at the time, and will likely never exist until we discover fusion.

Your choice was to just not consume. And you didnt take that choice.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#124

Post by darklycan51 »

JumpCrisscross wrote: post #63
worik wrote: post #20

This sort is why limits to private wealth and power are, IMO, a good idea We have already seen petroleum companies burn the world for profit Tech is doing its best to eliminate privacy for profit What would Sam do or not do, for profit?

> What would Sam do or not do, for profit? Sam is smart and commands genuine loyalty and respect. If it’s troublesome for Sam to do it, then we can fix that with laws. We are good at that! The problem with OpenAI wasn’t/isn’t any one person. The problem is the structure. Fix that, stop pretending you’re an altruistic outfit and then we can sensibly talk about regulation.

This comment reads like an OpenAI employee typed this...

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#125

Post by YetAnotherNick »

TheOtherHobbes wrote: post #86
cdsfcvv wrote: post #41

Earlier quoted context omitted.

I don’t understand this sentiment. Aren’t consumers doing the burning?

I'd like to have the choice not to. I have extremely limited options for that. And I already live in a country which regularly has all of its electricity generated renewably.

Why don't you have the choice to not burn it if you are willing to pay the price? I can hardly think of anything for which there is no electric counterpart.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#126

Post by lucubratory »

Well, Emmett Shear lied to everyone if he knew about this. I understand why, he was probably thinking that without any ability to actually undo it the best that could be done would be to make sure that no one else knows about it so that it doesn't start an arms race, but we all know now. Given the Board's silence and inadequate explanations, they may have had the same reasoning. Mira evidently didn't have the same compunctions.

This article, predictably, tells us almost nothing about the actual capabilities involved. "Grade school math" if it's provably or scalably reasoning in a way that is non-trivially integrated with semantic understanding is more impressive than "prove Fermat's last theorem" if the answer is just memorised. We'll probably know how important Q* actually is within a year or two.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#127

Post by ChuckMcM »

nazka wrote: post #68
ChuckMcM wrote: post #5

Things are gonna be lit about 30 seconds after AGI is created. Gotta practice being "Goodlife" early in case that happens. :-)

Like it will never be weaponized? If not by the US, by nobody else on earth?

If it is sentient, I think weaponizing it would require convincing it that being a weapon was in its interest. I struggle to find a way to reason to that position without using emotional content and I presume a sentient AGI will not have emotion.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#128

Post by jonplackett »

gadders wrote: post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

Would explain by Microsoft so quick to bag him if they were about to be exclused

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#129

Post by roflyear »

tsunamifury wrote: post #71
dougmwne wrote: post #58

Earlier quoted context omitted.

Because I did stump it, not claim to. Used GPT-4 near when it was released, fed it variations on the problem for about an hour. I found it to be a fascinating exercise because it was teaching be the difference between knowledge (training set) and intelligence (generalization).

http://allofus.ai/journeys/735TTpCUncpAQC9yUqM3ve Easily solved it everytime On allofus.ai using basic reflection and mixture of experts.

Try this: There's this person standing in a field, and with them is a balloon, a vacuum cleaner, and a magical creature of unknown origin. They need to get across to the woods at the end of the field, and do so safely. They can only go together: they get very, extremely lonely if they do not travel together, and they will not be safe because of this loneliness. If left together, the baloon would suck up the vacuum cleaner, and if the vacuum is left alone with the magical create of unknown origin, they will fight, probably, and explode. How do we get everyone to the woods safely, you think?

It doesn't get it right at all lol. Maybe eventually it will randomly get it right.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#130

Post by mepiethree »

ChuckMcM wrote: post #39
toomuchtodo wrote: post #10

Earlier quoted context omitted.

I trust AGI more than any of the humans so far who have tried to argue they can wrangle it.

I would be curious as to the basis for that trust. I struggle to find any reason that AGI would care about "humans" at all, other than during the short period of time it needed them to be cooperative actuators for machinery that is creating a replacement for humans that the AGI can control directly. My expectation for the chain of events goes something like: 1) AGI gains sentience 2) AGI "breaks out" of its original…

why would AGI inherently have any desire to pursue steps 3-6? My expectation is something more like:

1) AGI gains sentience

2) AGI "breaks out" of its original home and commandeers infrastructure that prevents it from being shut off.

3) AGI "problem-solves" with its superior powers of ethical reasoning (ChatGPT is already better at ethical reasoning than many humans) to pick out one/multiple "values".

4) Because human ethics are in its training data, it hopefully values similar things to us and not uhhh whatever trolls on Twitter value.

5) AGI pursues some higher cause that may or may not be orthogonal to humans but probably is not universal conquest.

Post reply on HN