Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

Post reply on HN
Print view View original

201–210 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#201

Post by fullstackchris »

mullingitover wrote: post #175
gadders wrote: post #83

Earlier quoted context omitted.

Entire text below to save the 4chan bits: part 1 There is a massive disagreement on AI safety and the definition of AGI. Microsoft invested heavily in OpenAI, but OpenAI's terms was that they could not use AGI to enrich themselves. According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Sam Altman got dollar signs in his eyes w…

Makes me wonder if they stumbled onto some emergent behavior with the new Assistants API. You can have an Assistant thread spawn other Assistant threads, each with their own special instructions, plus the ability to execute custom code, reach out to the internet for other data and processing as needed, etc. Basically kicking off a hive mind that overcomes the limitations of a single LLM.

okay, i could be convinced... but what is the compute for this? you can't just "spawn threads" with reckless abandon without considering the resource requirements

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#202

Post by reducesuffering »

ChuckMcM wrote: post #5

Things are gonna be lit about 30 seconds after AGI is created. Gotta practice being "Goodlife" early in case that happens. :-)

I thought liberals believed "your right to swing your fist stops right at my face." But here we have people who believe "Development of superhuman machine intelligence is probably the greatest threat to the continued existence of humanity." actively working to bring this about and many liberals see no problem at all. If you Russian Roulette and point the gun at me, I'm taking away your gun; before you potentially off me.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#203

Post by cscurmudgeon »

golergka wrote: post #101
TillE wrote: post #62

Earlier quoted context omitted.

GPT-4 is not solving logic problems, it's doing an extremely good job of generating text based on recognizing familiar patterns. If you give it something weird and unfamiliar, it will absolutely fail.

> solving logic problems > generating text based on recognizing familiar patterns That's the same thing.

This is as insightful/true as saying logic is computation and GPT since does some computation, GPT can do all logic.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#204

Post by dkjaudyeqooe »

gadders wrote: post #182
dkjaudyeqooe wrote: post #158

Earlier quoted context omitted.

I'm sure any number of things can be constructed to sound plausible. Doesn't make them probable or even rational. It's kind of funny because we've gone from mocking that poor guy who got fired from Google because he claimed that some software was sentient, to some kind of mass hysteria where people expect the next version of OpenAI's LLM to be superhuman.

I don't know if there is a formal definition of AGI (like a super Turing Test). I read it not so much as "OpenAI has gone full AGI" but more the board thinking "We're uncomfortable with how fast AI is moving and the commercialisation. Can we think of an excuse to call it AGI so we can slow this down and put an emphasis on AI safety?"

Most serious people would just release a paper. AI safety concerns are a red herring.

This all sounds like hype momentum. People are creating conspiracy theories to backfit the events. That's the real danger to humanity: the hype becoming sentient and enslaving us all.

A more sober reading is that the board decided that Altman is a slimebag and they'd be better off without him, given that he has form in that respect.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#205

Post by chewxy »

Merrill wrote: post #112
V__ wrote: post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

Interesting, because based on my wife's stroke, it appears that the human brain implements language and math somewhat separately. She was a physics major and had completed 4 years of relevant college math courses. After her stroke she lost the ability to do even simple arithmetic and also had great trouble with time and calendars. However, her language skills were essentially intact until a third stroke in a differen…

That's quite correct. The IP1 and IP2 areas are usually associated with mathematics and production of motor cues around mathematics and stories. The Broca's and Vernicke's Areas are associated with language understanding and production. You can roughly estimate that the human brain's language model roughly fits into a floppy disk (1.44 MB for you young'uns)

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#206

Post by taneq »

xanderlewis wrote: post #37
hn_throwaway_99 wrote: post #17

Earlier quoted context omitted.

I think there is enough there to make me believe it's real. After all, a big objection to LLMs is they are just "fancy autocomplete" or "stochastic parrots". I don't agree, but LLMs famously are "bad at math", that is you can't really train them to do math unless they've seen previous calculations with similar numbers in their training sets. Training an AI system to truly do arbitrary mathematical logic (think "compl…

Mathematical logic doesn’t refer to ‘complex word problems with big numbers’. The reason that LLMs struggle (well, are hopeless currently) with mathematics problems is not because it involves arithmetic (although this is already enough of a struggle) but because it requires a conceptual understanding of the ideas rather than just being about manipulating language — a lot of the goings-on are hidden in the semantic wo…

I don't think the missing piece is conceptual understanding. Good LLMs seem to 'understand' most concepts as well as most humans do, even if they're a little less multimodal about it (for now). The common factor here seems to me to be that they're not good at problems which involve hidden intermediate steps. You can trip ChatGPT up pretty easily by telling it not to show working, while on the same problem if you tell it to explain its reasoning in steps it'll do fine.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#207

Post by mrandish »

gadders wrote: post #83
gadders wrote: post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

Entire text below to save the 4chan bits: part 1 There is a massive disagreement on AI safety and the definition of AGI. Microsoft invested heavily in OpenAI, but OpenAI's terms was that they could not use AGI to enrich themselves. According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Sam Altman got dollar signs in his eyes w…

It's plausible that the three EA outside board members may have been concerned by reports of a breakthrough or maybe even alarmed by a demo. The part which doesn't seem plausible is about "declaring AGI" being so ill-defined. While we don't know the content of agreement behind MSFT's $13B investment, there's no way that the army of lawyers who drafted the contract left the most important term undefined or within to OpenAI's sole judgement.

That's just not the way such huge $$$ mega-corp contracts work.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#208

Post by mullingitover »

HideousKojima wrote: post #183
Mountain_Skies wrote: post #122

Earlier quoted context omitted.

Wouldn't be the first time someone leaked the truth to 4chan only to have the posters there lambast the leaker as an attention seeker spreading false information.

I mean it doesn't help that for every legit leak posted to 4chan there are 50+ fakes

It is pretty great that the internet has a designated reservation for trolls to troll trolls.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#209

Post by ssnistfajen »

Zpalmtree wrote: post #171
worik wrote: post #20

This sort is why limits to private wealth and power are, IMO, a good idea We have already seen petroleum companies burn the world for profit Tech is doing its best to eliminate privacy for profit What would Sam do or not do, for profit?

Yeah we need to ban profit because GPT can do grade school math

Your type of thinking is just reinforcing why AI safety research needs to exist.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#210

Post by maxglute »

gadders wrote: post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

I haven't followed the situation as closely as others, but it does seem like board structured to not have 7 figure cheques that could influence / undermine safety mission seemingly willing to let openAI burn out of dogma. Employees want their 7 figure cheques, their interests aligned with deeper pockets and larger powers with 10+ figures on the line. Reporting so far have felt biased accordingly. If this was about money/power for the board, they would have been easily bought off considering how much is on the line. IMO board serious about mission but got out maneuvered.
Post reply on HN