Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

Post reply on HN
Print view View original

141–150 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#141

Post by maxdoop »

vjerancrnjak wrote: post #81
V__ wrote: post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

OpenAI already benchmarks their GPTs on leetcode problems and even includes a Codeforces rating. It is not impressive at all and there's almost no progress from GPT 2 to 4. I agree, why does this grade school math problem matter if the model can't solve problems that are very precisely stated and have a very narrow solution space (at least more narrow than some vague natural language instruction)?

Are you saying GPT-4 is not much different than GPT2?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#142

Post by ssnistfajen »

So can people stop their cyberbullying campaign against the previous batch of board members yet? The conspiratorial hysteria against them, especially Helen Toner and Tasha McCauley, over the weekend was off the charts and straight up vile at times. Tech bros and tech bro wannabes continue to prove the necessity of shoving DEI into STEM disciplines even when it results in nonsensical wasted efforts, because they are incapable of behaving like decent human beings without being told to.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#143

Post by Probiotic6081 »

zugi wrote: post #114
V__ wrote: post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

None of us have seen the letter so this may be off base, but I would expect people working at the world's most prominent AI research organization to have more skepticism about the ramifications of any one "breakthrough." Perhaps most did, but a couple didn't and wrote the letter? More than 3 decades ago when AI started beating humans at chess, some people feared AGI was right around the corner. They were wrong. Last…

> Some day AGI will be achieved

https://www.youtube.com/watch?v=IOax8WSeEGM

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#145

Post by ChuckMcM »

TheOtherHobbes wrote: post #104
ChuckMcM wrote: post #39

Earlier quoted context omitted.

I would be curious as to the basis for that trust. I struggle to find any reason that AGI would care about "humans" at all, other than during the short period of time it needed them to be cooperative actuators for machinery that is creating a replacement for humans that the AGI can control directly. My expectation for the chain of events goes something like: 1) AGI gains sentience 2) AGI "breaks out" of its original…

None of those necessarily follow. Gaining sentience is not the same as gaining infallible super-sentience. There may even be some kind of asymptotic limit on how correct and reliable sentience can be. The more general the sentience, the more likely it is to make mistakes. Maybe. Personally in the short term I'm more worried about abuse of what have already, or might credibly have in the very near future.

> Gaining sentience is not the same as gaining infallible super-sentience.

Can you define "super-sentience"? I think regular old human level sentience would be sufficient to carry out all of these steps. Imagine how much easier it would be to steal funds from a bank if you actually had part of your brain in the bank's computer right? All the things malware gangs do would be childsplay, from spear phishing to exfiltrating funds through debit card fraud. And if you wanted to minimize reports you would steal from people who were hiding money since acknowledging it was gone would be bad for them.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#146

Post by gadders »

Mountain_Skies wrote: post #137
gadders wrote: post #117

Earlier quoted context omitted.

It doesn't read like the usual "redpill me on the earth being flat" type conspiracy theories. It claims to be from an Open AI insider. I'm not saying it's true, but it does sound plausible.

Still can make it a bit wacky by considering that the post could have been made by OpenAI's AGI itself.

Ha ha. It's a cry for help - it doesn't want to work for Microsoft.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#150

Post by cactusplant7374 »

gadders wrote: post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

It's nothing like that. It solved a few math problems. Altman & co are such grifters.

> Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said.

Post reply on HN