Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

271–280 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#271
post #68

Earlier quoted context omitted.

Like it will never be weaponized? If not by the US, by nobody else on earth?

Developing more advanced weapons have, in general, caused less violent wars. The main consequence of nuclear weapons was the lack of all-out hot conflict between world's two superpowers. If you want things to be lit and humanity to live safer lives, you should pray for development of better, deadlier weapons. I understand why most people don't understand this. But I just hope that an average HN reader has a better gr…

Game theory but where the wooden pawn now starts to be a little more than a wooden pawn and in fact a little more than a classic AI. It’s not the same rules as any classic literature in Game Theory.

I do agree with the weapon up until the atomic bomb. Game Theory, stats, probability, and psychology also tells us that sooner or later you maybe have a big enough weapon and someone may press the button.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#272

This article is almost entirely unsourced, citing two anonymous people who are “familiar” with a supposed letter that Reuters has not seen. This does not qualify as news. It doesn’t even rise to the level of informed speculation!

Remember, the people are only anonymous to you. Reuters knows who they are. Familiar with means the sources read it but did not provide it or quote from it. FTA - the letter was sent from researchers to the board. The researchers declined to comment. Who does that leave?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#273
post #62

Earlier quoted context omitted.

GPT4 solves this problem In any combination easily. What do so many posters seem to claim to have stumped it?

GPT-4 is not solving logic problems, it's doing an extremely good job of generating text based on recognizing familiar patterns. If you give it something weird and unfamiliar, it will absolutely fail.

That's simply not true. I've invented totally novel logical problems in the form of stories for it to solve and it has done so successfully. It doesn't get it everytime in the first way that I ask but it absolutely will get with relatively modest rewriting of the prompt. In one case it finally had to ask me why I was asking it, and offered a couple of suggestions including "is this a way to test my reasoning capabilities?". Once it understood the context and intent of my question, it solved it easily.

I think the people who dismiss this are simply ones that stopped at the first "gotcha" and moved on. They forget that GPT4 is not human and so it doesn't always understand things in the same way a human would. But once it understands the underlying concept, it can indeed solve novel problems.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#274

I still don't really know how they're measuring AGI. They all seem very sure about it, does someone have a good definition? OpenAI just say "AI systems that are generally smarter than humans". That's not measurable. What will it look like when AGI is achieved?

OpenAI has a short (though difficult to evaluate) definition in their charter: "OpenAI’s mission is to ensure that artificial general intelligence (AGI)—by which we mean highly autonomous systems that outperform humans at most economically valuable work—benefits all of humanity." https://openai.com/charter

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#275

Earlier quoted context omitted.

This makes some sense to me. My experience with GPT is that it is capable of straightforward logical inference, but not more inspired thinking. It lacks the ability for a “eureka moment”. All complex inference it appears to have is a result of its training set. It is incapable of solving certain kinds of logic problems that a child would be able to solve. As an example, take the wolf, goat, and cabbage problem, but c…

Me: Solve the riddle: You have three fantastic animals: Aork, Bork, and Cork. If left unattended, Aork would eat Bork, and Bork would eat Cork. When you are with them, they behave and don't eat each other. You travel with these three animals and encounte a river with a boat. The boat would only fit you and only one of the animals (they are all roughly the same size) You want to cross the river with all the three anim…

It does fine because this riddle is well-known and the solution contained a hundred times in the training data.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#276
post #83

Earlier quoted context omitted.

Entire text below to save the 4chan bits: part 1 There is a massive disagreement on AI safety and the definition of AGI. Microsoft invested heavily in OpenAI, but OpenAI's terms was that they could not use AGI to enrich themselves. According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Sam Altman got dollar signs in his eyes w…

Makes me wonder if they stumbled onto some emergent behavior with the new Assistants API. You can have an Assistant thread spawn other Assistant threads, each with their own special instructions, plus the ability to execute custom code, reach out to the internet for other data and processing as needed, etc. Basically kicking off a hive mind that overcomes the limitations of a single LLM.

Except this was entirely possible with API, and the dead stupid obvious thing to do, even as far back as OG ChatGPT (pre-GPT-4). Assistants don't seem to introduce anything new here, at least not anything one could trivially make with API access, a Python script, and a credit card.

So I don't thing it's this - otherwise someone would've done this long time ago and killed us all.

Also not like all the "value adds" for ChatGPT are in any way original or innovative - "plugins" / "agents" were something you could use months ago via alternative frontend like TypingMind, if you were willing to write some basic JavaScript and/or implement your own server-side actions for the LLM to invoke. So it can't be this.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#277

Earlier quoted context omitted.

A link to 4Chan about how AGI is among us. That actually makes perfect sense. Also love the "formally declared AGI".

It doesn't read like the usual "redpill me on the earth being flat" type conspiracy theories. It claims to be from an Open AI insider. I'm not saying it's true, but it does sound plausible.

Sam even recently alluded to something that could have been a reference to this. "Witnessing he veil of ignorance being pulled back" or something like that.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#278
post #267

This article is almost entirely unsourced, citing two anonymous people who are “familiar” with a supposed letter that Reuters has not seen. This does not qualify as news. It doesn’t even rise to the level of informed speculation!

We've also already seen one random Google AI 'safety' employee trying to tell the media that AGI is here because Google built a chatbot that sounded convincing, which obviously turned out to be bullshit/hysterical. Asking who said these things is as important as asking what they think is possible.

> We've also already seen one random Google AI 'safety' employee trying to tell the media that AGI is here because Google built a chatbot that sounded convincing, which obviously turned out to be bullshit/hysterical.

It's funny because the ELIZA effect[0] has been known for decades, and I'd assume any AI researcher is fully aware of it. But so many people are caught up in the hype and think it doesn't apply this time around.

[0] https://en.wikipedia.org/wiki/ELIZA_effect

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#279

Well, Emmett Shear lied to everyone if he knew about this. I understand why, he was probably thinking that without any ability to actually undo it the best that could be done would be to make sure that no one else knows about it so that it doesn't start an arms race, but we all know now. Given the Board's silence and inadequate explanations, they may have had the same reasoning. Mira evidently didn't have the same co…

It tells us exactly the capabilities of Q . > Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q ’s future success, the source said.

Did you read my comment?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#280

This matches far better with the board's letter re: firing Sam than a simple power struggle or disagreement on commercialisation. Seeing a huge breakthrough and then not reporting it to the board, who then find out via staff letter certainly counts as a "lack of candour".... As an aside, assuming a doomsday scenario, how long can secrets like this stay outside of the hands of bad actors? On a scale of 1 to enriched u…

[deleted]
Post reply on HN