Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

181–190 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#181
Let's repeat this: current LLMs != AGI. It will never be. It could be used for knowledge store, retrieval, synthesis, and low lever reasoning. There is at least a few decades worth of work remaining for it to reach the level of AGI. The proponents in this AI gold rush are casually throwing around the term without any real thought.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#182

Earlier quoted context omitted.

It doesn't read like the usual "redpill me on the earth being flat" type conspiracy theories. It claims to be from an Open AI insider. I'm not saying it's true, but it does sound plausible.

I'm sure any number of things can be constructed to sound plausible. Doesn't make them probable or even rational. It's kind of funny because we've gone from mocking that poor guy who got fired from Google because he claimed that some software was sentient, to some kind of mass hysteria where people expect the next version of OpenAI's LLM to be superhuman.

I don't know if there is a formal definition of AGI (like a super Turing Test). I read it not so much as "OpenAI has gone full AGI" but more the board thinking "We're uncomfortable with how fast AI is moving and the commercialisation. Can we think of an excuse to call it AGI so we can slow this down and put an emphasis on AI safety?"

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#183
post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

Wouldn't be the first time someone leaked the truth to 4chan only to have the posters there lambast the leaker as an attention seeker spreading false information.

I mean it doesn't help that for every legit leak posted to 4chan there are 50+ fakes

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#184

Let's repeat this: current LLMs != AGI. It will never be. It could be used for knowledge store, retrieval, synthesis, and low lever reasoning. There is at least a few decades worth of work remaining for it to reach the level of AGI. The proponents in this AI gold rush are casually throwing around the term without any real thought.

Wishful thinkin buddy

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#185
post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

It's nothing like that. It solved a few math problems. Altman & co are such grifters. > Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s…

yeah, they really sound like they're all high on their own supply.

however if they've really got something that can eventually solve math problems better than wolfram alpha / mathematica that's great, i got real disappointed early in chatgpt being entirely useless at math.

lemme know when the "AGI" gets bored and starts grinding through the "List of unsolved problems in mathematics" on its own and publishing original research that stands up to scrutiny.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#186
post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

It's nothing like that. It solved a few math problems. Altman & co are such grifters. > Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s…

It may be a good idea for CA state to step in, take control of that nonprofit and review a few months of the recent communications for violations of fiduciary duty for all the board members.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#187
post #140

Earlier quoted context omitted.

Why would AGI prefer want to avoid being turned off? Why would it want to spread across the universe? Those seem like petty human concerns derived from our evolutionary history. I see no reason to assume a superintelligent AI would share them.

If it has any goals at all, then being turned off is likely to prevent it from accomplishing those goals, whereas conquering its local environment is likely to help it achieve those goals, and spreading across the universe would help with a broad subset of possible goals. "Instrumental convergence" is the search term here.

That's an interesting argument. I suppose I would expect a superintelligent AI to lack goals. Or perhaps the smarter it is, the fainter its goals would be.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#188
post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

This makes some sense to me. My experience with GPT is that it is capable of straightforward logical inference, but not more inspired thinking. It lacks the ability for a “eureka moment”. All complex inference it appears to have is a result of its training set. It is incapable of solving certain kinds of logic problems that a child would be able to solve. As an example, take the wolf, goat, and cabbage problem, but c…

[deleted]

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#189

Earlier quoted context omitted.

A link to 4Chan about how AGI is among us. That actually makes perfect sense. Also love the "formally declared AGI".

It doesn't read like the usual "redpill me on the earth being flat" type conspiracy theories. It claims to be from an Open AI insider. I'm not saying it's true, but it does sound plausible.

“Insider” LARPers are a staple of 4chan.

Qanon started as one of these, obviously at first just to troll. Then it got out of hand and got jacked by people using it for actual propaganda.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#190
post #83

Earlier quoted context omitted.

Entire text below to save the 4chan bits: part 1 There is a massive disagreement on AI safety and the definition of AGI. Microsoft invested heavily in OpenAI, but OpenAI's terms was that they could not use AGI to enrich themselves. According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Sam Altman got dollar signs in his eyes w…

Makes me wonder if they stumbled onto some emergent behavior with the new Assistants API. You can have an Assistant thread spawn other Assistant threads, each with their own special instructions, plus the ability to execute custom code, reach out to the internet for other data and processing as needed, etc. Basically kicking off a hive mind that overcomes the limitations of a single LLM.

Given the name (Q*) it's probably pure RL.
Post reply on HN