Earlier quoted context omitted.
We can constrain their use, as with nuclear materials.
At some point in the probably near future it will be much simpler to create an autonomous AI agent than a nuclear bomb.
So let's avoid that future.
Fully autonomous AI agents should not be developed
31–40 of 47 posts
Re: Fully autonomous AI agents should not be developed
#32Re: Fully autonomous AI agents should not be developed
#33Too late. I added a 5 minute cron job for cursor AI's compose tab in agent mode that keeps replying "keep going, think of more fixes and features, random ideas as fine, do it all for me". I won't pull the plug.
You’ve created a monster
Re: Fully autonomous AI agents should not be developed
#34Earlier quoted context omitted.
It is a lot easier to detect illicit nuclear work compared to illicit AI work.
It is hard to hide anything that uses as much electricity as a large training run. Also there are only a few companies that can fab the semiconductors needed for these training runs.
You will run an autonomous ai agent on your own hardware or by having your own local ai pass out commands to distributed systems online, ai, real people, or just good old fashioned programming. There is no stopping this.
Re: Fully autonomous AI agents should not be developed
#35Earlier quoted context omitted.
It is hard to hide anything that uses as much electricity as a large training run. Also there are only a few companies that can fab the semiconductors needed for these training runs.
You will run an autonomous ai agent on your own hardware or by having your own local ai pass out commands to distributed systems online, ai, real people, or just good old fashioned programming. There is no stopping this.
[deleted]
Re: Fully autonomous AI agents should not be developed
#36Earlier quoted context omitted.
It is hard to hide anything that uses as much electricity as a large training run. Also there are only a few companies that can fab the semiconductors needed for these training runs.
You will run an autonomous ai agent on your own hardware or by having your own local ai pass out commands to distributed systems online, ai, real people, or just good old fashioned programming. There is no stopping this.
It is in fact possible to stop training runs that consume billions of dollars in electricity and in GPU rental or depreciation costs. If no one does such a training run, then no one can release the weights of the model that would have been produced by the run, so you won't be able to run the model (which would never come into existence) on your own hardware. I don't care if you run DeepSeek R1 in your basement till the end of time. What my friends and I want to stop is the creation of more capable future models.
It is also quite possible for our society to decide that deep learning is too dangerous and to outlaw teaching and publishing about it, which would not completely stop the discovery of algorithmic deep-learning improvements (because some committed deep-learning enthusiasts would break the law) but would slow the discovery rate way, way down.
Re: Fully autonomous AI agents should not be developed
#37Most of the arguments presented also apply to corporations.
There's no mention of externalities. That is, are the costs of AI errors borne by the operator of the AI, or a third party.
Re: Fully autonomous AI agents should not be developed
#38Hmm.. agent cannot do self-supervised learning without actually doing it. The trick is to keep it in a sandbox.
Re: Fully autonomous AI agents should not be developed
#39Too late. I added a 5 minute cron job for cursor AI's compose tab in agent mode that keeps replying "keep going, think of more fixes and features, random ideas as fine, do it all for me". I won't pull the plug.
How do you programmatically interact w cursor??
Re: Fully autonomous AI agents should not be developed
#40Earlier quoted context omitted.
You will run an autonomous ai agent on your own hardware or by having your own local ai pass out commands to distributed systems online, ai, real people, or just good old fashioned programming. There is no stopping this.
It is in fact possible to stop training runs that consume billions of dollars in electricity and in GPU rental or depreciation costs. If no one does such a training run, then no one can release the weights of the model that would have been produced by the run, so you won't be able to run the model (which would never come into existence) on your own hardware. I don't care if you run DeepSeek R1 in your basement till t…
But it’s not actually
possible for our society to decide that. In the real world, at this moment when laws and norms are gone and a billionaire obsessed with AI has power, that will 100% not happen. It won’t happen in the next several years, and that is the time left to do what you are saying. Pretending otherwise is a waste of time.