Live data from Hacker News

OpenAI checked to see whether GPT-4 could take over the world

arstechnica.com

11–16 of 16 posts

Re: OpenAI checked to see whether GPT-4 could take over the world

#11

This is a good reminder that when these models are intelligent enough to be dangerous not only will there be insufficient safeguards, but the developers won't even try to be safe. This is like confirming your gun isn't loaded by pointing it at your friend and pulling the trigger. Of course these models aren't dangerous - but that's becoming less and less certain as their capabilities develop. I'm not even how many mo…

> Imagine the Red Team for GPT-10 asks it to "convince me to help you take over the world" and it basilisks him successfully...

Seeing how the input for the commercial, plebian version seems to filter out "problematic" sources, we can be sure that none of us will get access to something like that. Governments have lists of "questionable", divergent people and their writings. They are free to train on them. I'd even go as far to say that most of these systems have been livetested and that they've only been released after years of steady Q&A and a lot of back and forth with the powers-that-be.

Re: OpenAI checked to see whether GPT-4 could take over the world

#13

This is a good reminder that when these models are intelligent enough to be dangerous not only will there be insufficient safeguards, but the developers won't even try to be safe. This is like confirming your gun isn't loaded by pointing it at your friend and pulling the trigger. Of course these models aren't dangerous - but that's becoming less and less certain as their capabilities develop. I'm not even how many mo…

Doubtful a language model can do these things because they haven't been done and it hasn't been trained on how to do them. Where is there good resources on how to take over the world? It also isn't like it's a thing you can just do anyway.

I feel like our jobs may be in danger, at least you'll have teams overseas using the tool a lot to produce code which maybe isn't great quality but who cares, but we're not in danger this way.

Re: OpenAI checked to see whether GPT-4 could take over the world

#14

OpenAI's marketing department checked if this headline would create a lot of clicks, after they reassured people that their LLM "AI" would definitely not take over the world.

True, but 'self-replication, and self-improvement' don't seem that implausible. If future corpora include LLM training repos and/or weights, we're not too far from imagining that an LLM with some overarching architecture (eg terminal access for training, similar to how Bing Chat apparently can issue and process search queries), could directly output model weights. Given the inherent difficulty of interpreting those weights, we arguably wouldn't be too far from a singularity definition.
Post reply on HN