Fully autonomous AI agents should not be developed
huggingface.co
Fully autonomous AI agents should not be developed
1–10 of 47 posts
Re: Fully autonomous AI agents should not be developed
#2Our analysis reveals that risks to people increase with the autonomy of a system: The more control a user cedes to an AI agent, the more risks to people arise. Particularly concerning are safety risks, which affect human life and impact further values.
Re: Fully autonomous AI agents should not be developed
#3This is a purely procedural question, not supporting or critiquing in any way-- other than this reads kind of like an editorial with the format of a scientific paper. The question is... are there rules about what constitutes a paper or can you just put whatever you want in there as long as you follow "scientific paper format"?
Re: Fully autonomous AI agents should not be developed
#4People are going to be developing these no matter what. Whether it wipes us out or not is just up to fate really.
Re: Fully autonomous AI agents should not be developed
#5the best way to get people to stop doing X is to tell them not to do X. works so well with my kid :)
Re: Fully autonomous AI agents should not be developed
#6This is a purely procedural question, not supporting or critiquing in any way-- other than this reads kind of like an editorial with the format of a scientific paper. The question is... are there rules about what constitutes a paper or can you just put whatever you want in there as long as you follow "scientific paper format"?
This looks like ICML formatting (and the submission deadline just passed).
ICML25 has an explicit call for position papers: https://icml.cc/Conferences/2025/CallForPositionPapers
Re: Fully autonomous AI agents should not be developed
#7This is a purely procedural question, not supporting or critiquing in any way-- other than this reads kind of like an editorial with the format of a scientific paper. The question is... are there rules about what constitutes a paper or can you just put whatever you want in there as long as you follow "scientific paper format"?
This looks like ICML formatting (and the submission deadline just passed). ICML25 has an explicit call for position papers: https://icml.cc/Conferences/2025/CallForPositionPapers
Wow, great observation. Thank you. Makes sense. I'd never heard of a "position paper" before.
Re: Fully autonomous AI agents should not be developed
#8I really enjoy Margaret Mitchell‘s podcast (she is the first author on the paper), and perhaps I missed something important in the paper, but:
Shouldn’t we treat separately autonomous agent we write ourselves, or purchase to run on our own computers, on our own data and that use public APIs for data?
If Margaret is reading this thread, I am curious what her opinion is.
For autonomous agents controlled by corporations and governments, I mostly agree with the paper.
Re: Fully autonomous AI agents should not be developed
#9People are going to be developing these no matter what. Whether it wipes us out or not is just up to fate really.
We can constrain their use, as with nuclear materials.