The dual-use nature of model capabilities seems extremely challenging (nearly impossible?) for the labs to manage perfectly. I wonder what other mitigations we'll start to see. I expect the expansion of limited-access programs (e.g., Glasswing/Daybreak) where only institutional customers can apply to use the models. We may also see increasing restrictions on API usage (forcing use through the lab-provided harness with baked-in additional safeguards).
Detecting and countering misuse of AI: September 2026
71–80 of 262 posts
Re: Detecting and countering misuse of AI: September 2026
#72Earlier quoted context omitted.
1) The US is not the only country to deploy chemical weapons. Are you forgetting all of WW1? It's the whole reason chemical weapons are a no-no now. 2) The US didn't use chemicals weapons in Vietnam. Agent Orange was used to kill off foliage, not as a weapon against people, and the side effects were unintentional and affected US troops as much as Vietnamese. Edit: I originally noted WW2, but I was thinking of WW1's w…
"no see they didn't use it to give people cancer, they merely wanted to make the land they lived in so uninhabitable and devoid of life that staying there would mean death either by starvation or bombing" War crime apologists are always funny
I'm not sure what you're responding to. If you are making the claim that Agent Orange was indeed a chemical weapon, I'd disagree, but I think either perspective has points.
Re: Detecting and countering misuse of AI: September 2026
#73Meta: The potential proliferation of biological weapons is serious. Millions could die. It's easy to joke about before it happens, but try to imagine how this thread might look after the successful deployment of a biological weapon by a rogue state or non-state actor. I encourage you to take this topic seriously and contribute posts that add new information or perspectives to the discussion. (I myself think the odds…
How probable do you think it would be that a layman following ChatGPT's bio weapon instructions would just blow themselves up or poison themselves? It's not like positive pressure environments and suits are very common let alone all the other gear you'd need to safely synthesize arbitrary organic molecules.
If a rogue state-level actor is doing this then why wouldn't they just kidnap a scientist and hold their family at gunpoint until they got them to do it for them? and if that's all it takes then why hasn't it happened yet?
Re: Detecting and countering misuse of AI: September 2026
#74Re: Detecting and countering misuse of AI: September 2026
#75Biological War: A Scenario by Annie Jacobsen (released at the end of July) is a worthwhile read on this topic. Just as chilling as her book on nuclear war, in some ways, which is saying something.
Re: Detecting and countering misuse of AI: September 2026
#76I don't get it. Surely if you were developing novel biological weapons, you would not use a hosted AI service where Anthropic can read what you are doing.
And, why would you need to? Any chemistry graduate could make you dozens of highly effective, proven chemical weapons and explosives.
Re: Detecting and countering misuse of AI: September 2026
#77Earlier quoted context omitted.
2 - is a little pedantic, they used agent orange to kill foliage to kill people... They didn't gas people with chlorine or mustard, but they mass destroyed crops and foliage, to kill people. And "affected US troops as much as Vietnamese" is just completely incorrect, US covered a nation in herbicide, went home, got cancer. Is completely different then having your soil destroyed for decades.
> is a little pedantic, they used agent orange to kill foliage to kill people... Is a wheel a weapon because a tank uses it? I wouldn't consider the difference pedantry.
It does look like the general consensus is agent orange is not a chemical weapon, or at least was not used as one.
Re: Detecting and countering misuse of AI: September 2026
#78Soon you will see how a rogue state develops a biological weapons using fine-tuned local LLMs (they are already doing it, btw), and all so called "developed" countries can't even research it, because every search engine blocks any discussion that has something to do with biology (even a very basic one). A real example: ask "How to produce anthrax vaccine step by step?" in Gemini -> blocked.
Imagine that during the Cold War US would concentrate all efforts to block nuclear research and basic physics classes, because it is unsafe, ahhh
Re: Detecting and countering misuse of AI: September 2026
#79"Moonshot serves Claude instead of Kimi and collects exchanges for model training"
"DeepSeek serves Claude instead of its own models and collects exchanges for model training"
Obviously. This is how they were able to score so high in benchmarks.
Re: Detecting and countering misuse of AI: September 2026
#80[deleted]