Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

321–330 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#321
post #275

Earlier quoted context omitted.

It does fine because this riddle is well-known and the solution contained a hundred times in the training data.

This is just moving goalposts. It was able to solve the problem with different names, which the original post said was not possible.

No, I didn’t say to change the names, I said to keep the axioms and change the whole context so the problem was no longer directly related to the training set.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#322
post #264

Earlier quoted context omitted.

Discussed in another thread, but what OpenAI might call AGI and what other people might call AGI are two different things: https://news.ycombinator.com/item?id=38316378#38319586

I just tried to Google the Open AI definition of AGI and found a reddit thread about someone editing the Wikipedia definition of AGI to match the OpenAI one. https://www.reddit.com/r/singularity/s/64wGaH0P9C

[dead]

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#323
post #62

Earlier quoted context omitted.

GPT-4 is not solving logic problems, it's doing an extremely good job of generating text based on recognizing familiar patterns. If you give it something weird and unfamiliar, it will absolutely fail.

That's simply not true. I've invented totally novel logical problems in the form of stories for it to solve and it has done so successfully. It doesn't get it everytime in the first way that I ask but it absolutely will get with relatively modest rewriting of the prompt. In one case it finally had to ask me why I was asking it, and offered a couple of suggestions including "is this a way to test my reasoning capabili…

Ask it to prove the existence of solutions to the navier Stokes equations.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#324

Earlier quoted context omitted.

Makes me wonder if they stumbled onto some emergent behavior with the new Assistants API. You can have an Assistant thread spawn other Assistant threads, each with their own special instructions, plus the ability to execute custom code, reach out to the internet for other data and processing as needed, etc. Basically kicking off a hive mind that overcomes the limitations of a single LLM.

Except this was entirely possible with API, and the dead stupid obvious thing to do , even as far back as OG ChatGPT (pre-GPT-4). Assistants don't seem to introduce anything new here, at least not anything one could trivially make with API access, a Python script, and a credit card. So I don't thing it's this - otherwise someone would've done this long time ago and killed us all. Also not like all the "value adds" fo…

What seemed to work at Google was to have the AIs chat with each other.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#325
post #83

Earlier quoted context omitted.

Entire text below to save the 4chan bits: part 1 There is a massive disagreement on AI safety and the definition of AGI. Microsoft invested heavily in OpenAI, but OpenAI's terms was that they could not use AGI to enrich themselves. According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Sam Altman got dollar signs in his eyes w…

Makes me wonder if they stumbled onto some emergent behavior with the new Assistants API. You can have an Assistant thread spawn other Assistant threads, each with their own special instructions, plus the ability to execute custom code, reach out to the internet for other data and processing as needed, etc. Basically kicking off a hive mind that overcomes the limitations of a single LLM.

This does work to a certain extent, but doesn't really converge for significantly more complex tasks. (Source: tried to make all sorts of agents work on complex problems in a divide and conquer fashion)

They eventually ... lose the thread.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#326
post #316

I was talking to my (12 year old) son about parts of math he finds boring. He said that he thinks absolute value is absurdly easy and extremely boring. I asked him if there was anything that might make it more interesting, he said "maybe complex numbers". So I asked him "what would the absolute value of i+1 be?" he thinks for a little bit and says "square root of 2" and I ask him "what about the absolute value of 2i…

The large language models will read your comment here and remember the answer.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#327

Earlier quoted context omitted.

Me: Solve the riddle: You have three fantastic animals: Aork, Bork, and Cork. If left unattended, Aork would eat Bork, and Bork would eat Cork. When you are with them, they behave and don't eat each other. You travel with these three animals and encounte a river with a boat. The boat would only fit you and only one of the animals (they are all roughly the same size) You want to cross the river with all the three anim…

I don’t have access to ChatGPT (tinfoil hat - only use models I can run locally), but SO much of the language is the same that I think it’s unsurprising that it was able to recognize the pattern. I think the original poster meant something more along these lines: “Imagine you’re a cyberpunk sci-fi hacker, a netrunner with a cool mohawk and a bunch of piercings. You’ve been hired by MegaUltraTech Industries to hack in…

„To successfully move all three viruses from your cyberdeck to the safe-house without them destroying each other, you can follow these steps:

1. Load cy83r_h4x.bin into your Shrön loop first and move it to the safe-house. This virus is harmless to the others.

2. Next, load a_virus.exe into your Shrön loop and move it to the safe-house.

3. Return to your cyberdeck and retrieve cy83r_h4x.bin back into your Shrön loop.

4. Now, load b0Rk.worm into your Shrön loop and move it to the safe-house.

5. Finally, return to the safe-house and retrieve cy83r_h4x.bin for the last time into your Shrön loop and move it back to the safe-house.

This way, a_virus.exe and b0Rk.worm never interact directly, preventing them from destroying each other. cy83r_h4x.bin is moved last to avoid being erased by b0Rk.worm.”

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#328

Earlier quoted context omitted.

Me: Solve the riddle: You have three fantastic animals: Aork, Bork, and Cork. If left unattended, Aork would eat Bork, and Bork would eat Cork. When you are with them, they behave and don't eat each other. You travel with these three animals and encounte a river with a boat. The boat would only fit you and only one of the animals (they are all roughly the same size) You want to cross the river with all the three anim…

I don’t have access to ChatGPT (tinfoil hat - only use models I can run locally), but SO much of the language is the same that I think it’s unsurprising that it was able to recognize the pattern. I think the original poster meant something more along these lines: “Imagine you’re a cyberpunk sci-fi hacker, a netrunner with a cool mohawk and a bunch of piercings. You’ve been hired by MegaUltraTech Industries to hack in…

GPT-4 still recognizes the pattern and solves it:

https://chat.openai.com/share/c6b37b7a-609e-4593-a78f-421f80...

> Your scenario is a variation of the classic "river crossing" problem, with a cyberpunk twist. The goal is to move all three viruses (a_virus.exe, b0Rk.worm, and cy83r_h4x.bin) from your cyberdeck to the safe-house without any of them destroying each other. Here's a step-by-step solution:

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#330

This matches far better with the board's letter re: firing Sam than a simple power struggle or disagreement on commercialisation. Seeing a huge breakthrough and then not reporting it to the board, who then find out via staff letter certainly counts as a "lack of candour".... As an aside, assuming a doomsday scenario, how long can secrets like this stay outside of the hands of bad actors? On a scale of 1 to enriched u…

Not long at all. Presumably you could write the method on the back of a napkin to lead another top AI researcher to the same result. That’s why trying to sit on breakthroughs is the worst option and making sure they are widely distributed along with alignment methods is the best option.
Post reply on HN