Live data from Hacker News

OpenAI Preparedness Challenge

openai.com

21–30 of 160 posts

Re: OpenAI Preparedness Challenge

#22
Regarding image and content generation

I am annoyed now that it's hard for me to tell if some recruiting industry is real or not. Since you can generate all the headshots, make all the users, buy some domain for a few years, put a WP site up, get all the business hierarchy crawlers fed with these people that may not exist...

To be clear, you don't need "AI" to do this but it makes it much easier.

I do want AGI to be a thing one day, I guess it would be cool/also insurance to carry on human legacy.

Re: OpenAI Preparedness Challenge

#23
My vote would be to mandate a remote kill switch system to be installed in all sufficiently capable robotic entities, e.g. the humanoid robots being built by OpenAI/Tesla/Figure, that we are likely to see in the millions within decades.

- The kill switch system can only be used to remotely deactivate a robot.

- The kill switch system is not allowed to be developed or controlled by the robot manufacturer.

- The kill switch system should be built using verifiable hardware and software, ideally fully open source and supported by formal verification.

- The kill switch system should with best effort be isolated from the robot hardware and software systems, and only interact by physically disconnecting power to the robot.

- Access to engage the kill switches would be provided to the executive branch of the nation in which the robot is operating.

Nothing will be a panacea against AI or robot risk, so it seems sensible to introduce different layers in a Swiss cheese model for safety, where a remote kill switch not controlled by the manufacturer could provide one such safety mechanism.

(You'd also want to add high-level state readout for the robot via the remote kill switch system to allow the controlling entity to e.g. be able to disable all robots within a geographical area etc.)

Re: OpenAI Preparedness Challenge

#24

This kinda of crowdsourcing just feels.... f'ing weird man. It's like if, after the 1993 WTC bombing, but before 9/11, the FBI and NY Port Authority went around asking people how they would attack NYC if they were to become terrorists and... then how they would suggest detecting and stopping said attack. And please be as detailed as possible. Leave your name and phone number. Best answer gets season tickets to the Ya…

https://en.wikipedia.org/wiki/Hundred_Flowers_Campaign

(only semi-serious)

Re: OpenAI Preparedness Challenge

#25

I think we are already seeing really bad use cases already. Just go to youtube, newspapers, etc and see all the bot comments regarding the current Gaza situation. PS: I'm in a burner account because I'm afraid that my employer will kick me out for not agreeing with the methods of the "right side"

I was thinking about this, what if you blocked incoming traffic from other countries. Would that stop external meddling "in country, intranet" ha.

Re: OpenAI Preparedness Challenge

#26

My vote would be to mandate a remote kill switch system to be installed in all sufficiently capable robotic entities, e.g. the humanoid robots being built by OpenAI/Tesla/Figure, that we are likely to see in the millions within decades. - The kill switch system can only be used to remotely deactivate a robot. - The kill switch system is not allowed to be developed or controlled by the robot manufacturer. - The kill s…

- Access to engage the kill switches would be provided to the executive branch of the nation in which the robot is operating.

Good plan, but this is the weak spot. You'd also want to do something like hand out remote kill switch access to citizens selected at random, who should not publicize this duty in any way. Alternatively, most if not all governments should have cross-country killswitch privileges. At any rate, the deployment of a killswitch in a single chain of command should not be considered sufficient.

Let's at least die with a little less embarrassment than "the AI bribed the killswitch operator."

Re: OpenAI Preparedness Challenge

#27

While I applaud how much OpenAi fears these negatives, given the current state of Ai trajectory, it won't be long until a future open source model gets "uncensored" and is easily usable for tons and tons of malicious intent. There already exists a fantastic "uncensored" model with the newly released Dolphin Mistral 7b. I saw some results from others where the model could easily give explosives recipes from existing p…

> write racist poems

That's way down toward the very bottom of my list of concerns about AI

If it wants to pit us against each other, it won't be via racist poetry.

Re: OpenAI Preparedness Challenge

#29

This kinda of crowdsourcing just feels.... f'ing weird man. It's like if, after the 1993 WTC bombing, but before 9/11, the FBI and NY Port Authority went around asking people how they would attack NYC if they were to become terrorists and... then how they would suggest detecting and stopping said attack. And please be as detailed as possible. Leave your name and phone number. Best answer gets season tickets to the Ya…

That is essentially what happened!

The FBI asked researchers and university professors precisely this question. They then used the proposed attack vectors to formulate a plan to protect the nation.

This was all supposed to be done in secret. After all, we don’t want to “give the terrorists ideas.”

The reason I know about this at all is because someone found one such paper was accidentally published on a public FTP site alongside a bunch of non-classified government-funded research.

The content was horrifying. One professor came up with a laundry list of imaginative ways to end society… on a budget.

Re: OpenAI Preparedness Challenge

#30

This kinda of crowdsourcing just feels.... f'ing weird man. It's like if, after the 1993 WTC bombing, but before 9/11, the FBI and NY Port Authority went around asking people how they would attack NYC if they were to become terrorists and... then how they would suggest detecting and stopping said attack. And please be as detailed as possible. Leave your name and phone number. Best answer gets season tickets to the Ya…

Best answer gets 25,000 lbs of explosive
Post reply on HN