Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

Post reply on HN
Print view View original

131–140 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#131

Post by pk-protect-ai »

tyingq wrote: post #61
xanderlewis wrote: post #37

Earlier quoted context omitted.

Mathematical logic doesn’t refer to ‘complex word problems with big numbers’. The reason that LLMs struggle (well, are hopeless currently) with mathematics problems is not because it involves arithmetic (although this is already enough of a struggle) but because it requires a conceptual understanding of the ideas rather than just being about manipulating language — a lot of the goings-on are hidden in the semantic wo…

I've seen it gets tripped up if you mix something common with something uncommon. ChatGPT chokes on, for example: "Two trains on separate tracks, 30 miles from each other are approaching each other, each at a speed of 10 mph. How long before they crash into each other?"

Some more interesting results. It is much better now at solving tasks in laconic mode (though these tasks GPT-4 were able to solve from day one, but spilled it's guts to unbearable extent):

The mother is older than her daughter 4 times now, in 3 years she will be older then her daughter only 3 times. How old are they both now? Be laconic, do not explain anything. The mother is 24 years old, the daughter is 6 years old.

In a fantasy land (map is 255x255) Karen have a quest to kill a monster (an ogre - a cannibal giant). This isn't an easy task. The ogre is huge and experienced human hunter. Karen has only 1/2 chance to kill this ogre. If she can't kill the ogre from a first attempt she will die. Ogre is located at (12,24), Karen is located at (33,33). Karen can improve her chances to kill an ogre for additional 25% by gathering the nightshades at (77,77). In addition she can receive the elves blessing from elves shaman, wich will increase her chances by additional 25%, at the elves village (125,200). However this blessing is not cost free. She need to bring the fox fur with her as a payment for the blessing ritual. The foxes may be found in a forest which is located between (230,40) and (220,80). For the ritual to be most effective she should hold the nightshades in her hands during the ritual. Find the shortest path for Karen to improve her chances of killing the ogre and survive. Do not explain anything, be laconic, print out the resulting route only. Karen's route: (33,33) -> (77,77) -> (230,60) -> (125,200) -> (12,24).

This additional explanation "(an ogre - a cannibal giant)" was added actually for LLaMA 2 to, but I keep it in this redaction for all models.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#133

Post by dkjaudyeqooe »

You've got to hand it to OpenAI for their bleeding edge marketing strat:

"WE'VE GOT AN AGI IN THIS CABINET RIGHT HERE AND WE DON'T WANT TO LET IT OUT BECAUSE IT'S SO POWERFUL, IT'S SO AI YOU HAVE NO IDEA, BEST YOU THROW MONEY AT US AND WE'LL KEEP EVERYONE SAFE BUT SORRY YOU"RE ALL REDUNDANT BECAUSE AGI, SORRY"

You'd think that so soon after so many Crypto scams people would be just a wee bit less credulous.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#134

Post by JumpCrisscross »

darklycan51 wrote: post #124
JumpCrisscross wrote: post #63

Earlier quoted context omitted.

> What would Sam do or not do, for profit? Sam is smart and commands genuine loyalty and respect. If it’s troublesome for Sam to do it, then we can fix that with laws. We are good at that! The problem with OpenAI wasn’t/isn’t any one person. The problem is the structure. Fix that, stop pretending you’re an altruistic outfit and then we can sensibly talk about regulation.

This comment reads like an OpenAI employee typed this...

Ha, read my comments over the past days. I was giving a strong benefit of doubt to the board.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#135

Post by golergka »

nazka wrote: post #68
ChuckMcM wrote: post #5

Things are gonna be lit about 30 seconds after AGI is created. Gotta practice being "Goodlife" early in case that happens. :-)

Like it will never be weaponized? If not by the US, by nobody else on earth?

Developing more advanced weapons have, in general, caused less violent wars. The main consequence of nuclear weapons was the lack of all-out hot conflict between world's two superpowers. If you want things to be lit and humanity to live safer lives, you should pray for development of better, deadlier weapons.

I understand why most people don't understand this. But I just hope that an average HN reader has a better grasp on game theory.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#136

Post by CrazyStat »

tsunamifury wrote: post #76
TillE wrote: post #62

Earlier quoted context omitted.

GPT-4 is not solving logic problems, it's doing an extremely good job of generating text based on recognizing familiar patterns. If you give it something weird and unfamiliar, it will absolutely fail.

I’m tired of this repetitive statement which is so ridiculous. That’s what you do to! You obviously have to reason using in the fly models on how to pick the next word.

> obviously

This is not at all obvious to me. Symbolic reasoning feels quite different from picking the next word. Using physical demonstrations (or mental models of physical demonstrations) feels quite different from picking the next word.

Over the years I’ve come to believe that claims that something is “obvious” tell you more about the claimant’s state of mind than about the thing being claimed.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#137

Post by Mountain_Skies »

gadders wrote: post #117
dkjaudyeqooe wrote: post #102

Earlier quoted context omitted.

A link to 4Chan about how AGI is among us. That actually makes perfect sense. Also love the "formally declared AGI".

It doesn't read like the usual "redpill me on the earth being flat" type conspiracy theories. It claims to be from an Open AI insider. I'm not saying it's true, but it does sound plausible.

Still can make it a bit wacky by considering that the post could have been made by OpenAI's AGI itself.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#138

Post by famouswaffles »

zugi wrote: post #114
V__ wrote: post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

None of us have seen the letter so this may be off base, but I would expect people working at the world's most prominent AI research organization to have more skepticism about the ramifications of any one "breakthrough." Perhaps most did, but a couple didn't and wrote the letter? More than 3 decades ago when AI started beating humans at chess, some people feared AGI was right around the corner. They were wrong. Last…

>Last year a Google researcher thought his chat bot was sentient ( https://www.scientificamerican.com/article/google-engineer-c... .) He was wrong.

You've figured out how to test for sentience ?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#139

Post by Davidzheng »

aoki wrote: post #93
NewJazz wrote: post #8

Given vast computing resources, the new model was able to [...] [perform] math on the level of grade-school students

Plot twist: it gets 25/25 on AMC 8

I think it's 50/50 chance this happens within a year regardless of this announcement.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#140

Post by slibhb »

ChuckMcM wrote: post #39
toomuchtodo wrote: post #10

Earlier quoted context omitted.

I trust AGI more than any of the humans so far who have tried to argue they can wrangle it.

I would be curious as to the basis for that trust. I struggle to find any reason that AGI would care about "humans" at all, other than during the short period of time it needed them to be cooperative actuators for machinery that is creating a replacement for humans that the AGI can control directly. My expectation for the chain of events goes something like: 1) AGI gains sentience 2) AGI "breaks out" of its original…

Why would AGI prefer want to avoid being turned off? Why would it want to spread across the universe? Those seem like petty human concerns derived from our evolutionary history. I see no reason to assume a superintelligent AI would share them.
Post reply on HN