Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pause Giant AI Experiments: An Open Letter

futureoflife.org

Post reply on HN
Print view View original

741–750 of 1001 posts

Re: Pause Giant AI Experiments: An Open Letter

#741

Post by krainboltgreene »

gautamdivgi wrote: post #719
nopinsight wrote: post #695

Earlier quoted context omitted.

A Manhattan project on AI Alignment, if started now, might still succeed in time. Therefore, the compliance between parties needs not be long-term, which is indeed unlikely to happen. China, which is the country outside the west with the highest (engineering) capability to train something more powerful than GPT-4, is very concerned about domestic stability and they also do not want an easily replicable alien tool wit…

I would hazard that any country with a declining population will aggressively adopt LLMs because it gives their leaner workforce more efficiency.

That sounds like an incredible way to destroy:

  - productivity
  - output
  - confidence
  - your neck if you happen to be in charge

Re: Pause Giant AI Experiments: An Open Letter

#743

Post by goldenshale »

How silly. Imagine telling Elon to pause development of all new rockets until people become comfortable with Starlink? Are language models really that scary?

It feels like it has become trendy for everyone to worry about everything rather than to look to the future, be creative, and explore all of the amazing uses and problems that we can start tackling.

Re: Pause Giant AI Experiments: An Open Letter

#744

Post by hackan »

goldenshale wrote: post #743

How silly. Imagine telling Elon to pause development of all new rockets until people become comfortable with Starlink? Are language models really that scary? It feels like it has become trendy for everyone to worry about everything rather than to look to the future, be creative, and explore all of the amazing uses and problems that we can start tackling.

Elon has signed that letter :P

Re: Pause Giant AI Experiments: An Open Letter

#745

Post by JoshuaDavid »

dmz73 wrote: post #737

Best response to the current "AI" fad driven fear I've seen so far (not my words): These AI tools cannot do things. They create text (or images or code or what-have-you) in response to prompts. And that's it! It is impressive, and it is clearly passing the Turing Test to some degree, because people are confusing the apparent intelligence behind these outputs with a combination of actual intelligence and "will." Not o…

https://openai.com/blog/chatgpt-plugins

Re: Pause Giant AI Experiments: An Open Letter

#747

Post by NhanH »

JoshuaDavid wrote: post #745
dmz73 wrote: post #737

Best response to the current "AI" fad driven fear I've seen so far (not my words): These AI tools cannot do things. They create text (or images or code or what-have-you) in response to prompts. And that's it! It is impressive, and it is clearly passing the Turing Test to some degree, because people are confusing the apparent intelligence behind these outputs with a combination of actual intelligence and "will." Not o…

https://openai.com/blog/chatgpt-plugins

I'm gonna request more explanations and proof, or at least theoretical path on using Expedia, Zapier, Instacart, Kayak etc. to dominate the world and kill every single human on earth.

Re: Pause Giant AI Experiments: An Open Letter

#748

Post by hackerlight »

illiarian wrote: post #592
xianshou wrote: post #355

Two-party iterated prisoner's dilemma is hard enough. Sensible players will coordinate with something like tit-for-tat, but that only works when both parties start off on the right foot. Regardless of initial strategy, the chances of degenerating towards the mutual-defection Nash equilibrium increase with the number of parties. The only prior example of world coordination at this level would be nuclear disarmament ac…

> The only prior example of world coordination at this level would be nuclear disarmament achieved via the logic of mutually assured destruction Or eradication of infectious diseases such as polio

Not a valid comparison because there is no incentive to dissent. Unlike with nuclear arms or AI, there is an incentive to dissent, because being the only group with access to this tech is an advantage.

Re: Pause Giant AI Experiments: An Open Letter

#749

Post by pornel »

dmz73 wrote: post #737

Best response to the current "AI" fad driven fear I've seen so far (not my words): These AI tools cannot do things. They create text (or images or code or what-have-you) in response to prompts. And that's it! It is impressive, and it is clearly passing the Turing Test to some degree, because people are confusing the apparent intelligence behind these outputs with a combination of actual intelligence and "will." Not o…

A river has no will, but it can flood and destroy. A discussion whether AI does something because it "wants" to or not, is just philosophy and semantics. But it may end up generating a series of destructive instructions anyway.

We feed these LLMs all of the Web, including instructions how to write code, and how to write exploits. They could become good at writing sandbox escapes, and one day write one when it just happens to fit some hallucinated goal.

Re: Pause Giant AI Experiments: An Open Letter

#750

Post by pornel »

NhanH wrote: post #747
JoshuaDavid wrote: post #745

Earlier quoted context omitted.

https://openai.com/blog/chatgpt-plugins

I'm gonna request more explanations and proof, or at least theoretical path on using Expedia, Zapier, Instacart, Kayak etc. to dominate the world and kill every single human on earth.

It could discover the next https://en.wikipedia.org/wiki/Shellshock_(software_bug)

Humans are very good at producing CVEs, and we're literally training models to be good at finding exploits: https://www.microsoft.com/en-us/security/business/ai-machine...

Post reply on HN