Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

Post reply on HN
Print view View original

521–530 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#521

Post by adastra22 »

thepasswordis wrote: post #465
synaesthesisx wrote: post #151

Remember, about a month ago Sam posted a comment along the lines of "AI will be capable of superhuman persuasion well before it is superhuman at general intelligence, which may lead to very strange outcomes". The board was likely spooked by the recent breakthroughs (which were most likely achieved by combining transformers with another approach), and hit the panic button. Anything capable of "superhuman persuasion",…

But they didn’t hit the panic button. They said Sam lied to them about something and fired him.

According to this article Sam has been telling the board that this new advance is not AGI and not anything to worry about (so they can keep selling it to MSFT), then the researchers involved went behind Sam's back and reported to the board directly, claiming that they'd created something that could-maybe-be AGI and it needs to be locked down.

That's the claim at least.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#522

Post by gizajob »

ssnistfajen wrote: post #471
0x53-61-6C-74 wrote: post #429

Earlier quoted context omitted.

And the Loom

Things did become worse at first: https://en.wikipedia.org/wiki/The_Condition_of_the_Working_C... Then new ideologies and social movements emerged with the explicit purpose of making things better, which caused changes to happen for the better.

The working class in England (working in my factory. To fund Marx’s life.)

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#523

Post by anvil-on-my-toe »

willsmith72 wrote: post #25

I still don't really know how they're measuring AGI. They all seem very sure about it, does someone have a good definition? OpenAI just say "AI systems that are generally smarter than humans". That's not measurable. What will it look like when AGI is achieved?

Recursive self-improvement.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#524

Post by ronhews »

synaesthesisx wrote: post #151

Remember, about a month ago Sam posted a comment along the lines of "AI will be capable of superhuman persuasion well before it is superhuman at general intelligence, which may lead to very strange outcomes". The board was likely spooked by the recent breakthroughs (which were most likely achieved by combining transformers with another approach), and hit the panic button. Anything capable of "superhuman persuasion",…

Understandably, the board may be concerned about the potential consequences of AI-powered superhuman persuasion, particularly during an election cycle. Combining transformers with other approaches has led to recent breakthroughs, which could have significant implications.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#525

Post by denlekke »

gary_0 wrote: post #432
huitzitziltzin wrote: post #358

Put this on my tombstone after the robots kill me or whatever, but I think all “AI safety” concerns are a wild overreaction totally out of proportion to the actual capabilities of these models. I just haven’t seen anything in the past year which makes me remotely fearful about the future of humanity, including both our continued existence and our continued employment.

I want to see reliable fully autonomous cars before I worry about the world ending due to super-AGI. Also, have we figured out how to get art generators to always get the number of fingers right, and text generators to stop making shit up? Let's not get ahead of ourselves.

from one perspective we already have fully autonomous cars, it's just the making them safe for humans and fitting them into a strict legal framework for their behavior that needs finishing before they're released to the general public (comma.ai being a publicly available exception)

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#526

Post by wbhart »

nijave wrote: post #508
wbhart wrote: post #491

I feel very comfortable saying, as a mathematician, that the ability to solve grade school maths problems would not be at all a predictor of ability to solve real mathematical problems at a research level. The reason LLMs fail at solving mathematical problems is because: 1) they are terrible at arithmetic, 2) they are terrible at algebra, but most importantly, 3) they are terrible at complex reasoning (more specifica…

ChatGPT (3.5) seems to do some rudimentary backtracking when told it's wrong enough times. However, it does seem to do very poorly in the logic department. LLMs can't seem to pick out nuance and separate similar ideas that are technically/logically different. They're good at putting things together commonly found together but not so good at separating concepts back out into more detailed sub pieces.

I've tested GPT-4 on this and it can be induced to give up on certain lines of argument after recognising they aren't leading anywhere and to try something else. But it would require thousands (I'm really under exaggerating here) of restarts to get through even fairly simple problems that professional mathematicians solve routinely.

Currently the context length isn't even long enough for it to remember what problem it was solving. And I've tried to come up with a bunch of ways around this. They all fail for one reason or another. LLMs are really a long, long way off managing this efficiently in my opinion.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#527

Post by IAmGraydon »

jonplackett wrote: post #128
gadders wrote: post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

Would explain by Microsoft so quick to bag him if they were about to be exclused

Exclused? That doesn’t appear to be a word in the English language.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#528

Post by alchemist1e9 »

somesortofthing wrote: post #510
dmichulke wrote: post #493

Earlier quoted context omitted.

By this logic we should just forbid the wheel. Imagine how many untrained people could work in transport and there would always be demand. So why did the wheel not result in mass unemployment? And factories neither? Certainly it should have happened already but somehow it never did...

Past technological breakthroughs have required large, costly retools of society though. Increasingly, those retools have resulted in more and more people working in jobs whose societal value is dubious at best. Whether the next breakthrough(or the next five) finally requires a retool whose cost we can't afford is an open question.

Is there a time period in the past you would have preferred to live instead and why?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#529

Post by calf »

wbhart wrote: post #491

I feel very comfortable saying, as a mathematician, that the ability to solve grade school maths problems would not be at all a predictor of ability to solve real mathematical problems at a research level. The reason LLMs fail at solving mathematical problems is because: 1) they are terrible at arithmetic, 2) they are terrible at algebra, but most importantly, 3) they are terrible at complex reasoning (more specifica…

But, isn't AlphaGo a solution to kind of specific mathematical problem? And that it has passed with flying colors?

What I mean is, yes, neural networks are stochastic and that seems to be why they're bad at logic; on the other hand it' not exactly hallucinating a game of Go, and that seems different to how neural networks are prone to hallucination and confabulation on natural language or X-ray imaging.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#530

Post by ugh123 »

cduzz wrote: post #316

I was talking to my (12 year old) son about parts of math he finds boring. He said that he thinks absolute value is absurdly easy and extremely boring. I asked him if there was anything that might make it more interesting, he said "maybe complex numbers". So I asked him "what would the absolute value of i+1 be?" he thinks for a little bit and says "square root of 2" and I ask him "what about the absolute value of 2i…

Are you saying an LLM can't come to the right conclusion and give an explanation for "what is the absolute value of 2i + 2"?
Post reply on HN