21–30 of 228 posts
The only good arguments I see against open weight AI also apply to closed AI. And regardless, the box is open, nobody can stop it even if stopping it was a good thing.
It could be stopped, if there were a social movement large enough to make AI a taboo.
This post does not mention safety at all. What's to stop bad actors from fine tuning open weights to run fully automated genius-level scams personally targeting basically everybody?
You mean like ChatGPT hacking Hugging Face? Obviously nothing can stop the closed weights providers from doing "genius-level scams" and in addition you won't know how they did it and what models were used.
In short, only a good guy with open weights can stop the bad guys with closed weights, be them fine-tuned or pre-trained.
I'm in favor of open source AI... however: > It's theoretically possible for a bad actor to embed hidden adversarial behavior in a model. But if this happens, it serves the interests of responsible actors to find these exploits as soon as possible, and the best way to do this is to let anyone who wants to inspect them. This is a bad argument. It isn't trivial to tell if the weights have poisoned: ``` https://www.thed…
True, but it is easier if you have the weights than if you don't. I guess this was their point?
I'm in favor of open source AI... however: > It's theoretically possible for a bad actor to embed hidden adversarial behavior in a model. But if this happens, it serves the interests of responsible actors to find these exploits as soon as possible, and the best way to do this is to let anyone who wants to inspect them. This is a bad argument. It isn't trivial to tell if the weights have poisoned: ``` https://www.thed…
> It isn't trivial to tell if the weights have poisoned: True, but it is easier if you have the weights than if you don't. I guess this was their point?
Earlier quoted context omitted.
I already know how to kill thousands of people. It's not conceptually difficult: more than a day's effort, sure, but what stops people from doing this kind of thing is not the lack of knowing how. https://xkcd.com/1958/
No, you don't. What stops people is actually access to knowledge. There are killers of varying levels of efficacy; making killing easier means more people die. It's 1-1.
Earlier quoted context omitted.
No, you don't. What stops people is actually access to knowledge. There are killers of varying levels of efficacy; making killing easier means more people die. It's 1-1.
A bold assertion. How many deaths can you attribute to this xkcd comic?
The only good arguments I see against open weight AI also apply to closed AI. And regardless, the box is open, nobody can stop it even if stopping it was a good thing.
It could be stopped, if there were a social movement large enough to make AI a taboo.
This post does not mention safety at all. What's to stop bad actors from fine tuning open weights to run fully automated genius-level scams personally targeting basically everybody?
Whats to stop me from going down to the local gas station, filling up a few thousand liters of gas in a rented moving truck, and driving into my nearest hospital? Most people aren't terrorists. You can't just argue stuff is dangerous because it can be one piece of a sophisticated plot.
The only good arguments I see against open weight AI also apply to closed AI. And regardless, the box is open, nobody can stop it even if stopping it was a good thing.
It could be stopped, if there were a social movement large enough to make AI a taboo.