> Illicit distillation Really... what makes it illicit?
[dead]
Detecting and countering misuse of AI: September 2026
231–240 of 262 posts
Re: Detecting and countering misuse of AI: September 2026
#232Earlier quoted context omitted.
I’ve seen the supposed Kimi thinking output yap about Anthropic’s guidelines and whatnot on many occasions - could also be the result of distillation, but also that straight up being Claude’s output. To be honest I've also gotten Kimi to do an okay proof of concept for SQLi though mostly in a more defensive role, like "Let's see how big of a problem this is", while Claude complained about CVP on the same task.
They all do it. If you ask Claude which model it is in Chinese, it says DeepSeek or Qwen.
[deleted]
Re: Detecting and countering misuse of AI: September 2026
#233Earlier quoted context omitted.
It's the usual propaganda. They want to insinuate how powerful their models are and achieve government regulation. Win-win.
Is this belief falsifiable? Consider e.g. the fact that Daniel Kokotajlo left OpenAI due to his concerns even though it meant leaving equity on the table.
Are you commenting on the wrong thread? This isn't about somebody leaving.
Re: Detecting and countering misuse of AI: September 2026
#234Meta: The potential proliferation of biological weapons is serious. Millions could die. It's easy to joke about before it happens, but try to imagine how this thread might look after the successful deployment of a biological weapon by a rogue state or non-state actor. I encourage you to take this topic seriously and contribute posts that add new information or perspectives to the discussion. (I myself think the odds…
There are already scores of people capable of building biological weapons or doing GOF work which ends up being essentially the same thing. There’s no need for an LLM, just a phd in virology, a decent lab, and a handful of grad students. [0] All of which, rogue actors have easy access to and could have accomplished for a few millions dollars anytime in the last decade. And yet, we aren’t drowning in our own blood whi…
We have somewhere between 0% If I don't trust the credentialed virologists without AI based on perceived precedent, I'm certainly not going to trust them with AI to accelerate their their unabated workstreams.
Note: per my HN profile, I am an advisor for BiosafetyNow.
Re: Detecting and countering misuse of AI: September 2026
#235the inline link to the page to the report was Slashdotted for a moment (yesssssss), but here is the report directly now: https://www-cdn.anthropic.com/e50be2e51e7695dc4b1366a37a245a...
Fascinating document - the headline (can't ready the article) talking about a bioweapon (i.e. a weird obsession of anthropic's) really buries the interesting part.
weird obsession. really.
Here, have a Kevin Esvelt, now-tenured professor at MIT: https://www.nytimes.com/2026/04/29/us/ai-chatbots-biological...
disclosure: I am an advisor for BiosafetyNow.
Re: Detecting and countering misuse of AI: September 2026
#236Quite the double standard here... Conventional Weapons -We identified a cell of threat actors based in northern Yemen -We identified a China-based threat actor who used Claude -We identified likely freelance Russia-based threat actors -We identified a China-based actor who used Claude’s chat -In this case, a Russia-based actor used Claude -We identified a China-based threat actor who used Claude Biological misuse We…
From this double standard, we can infer the country is one that the US would have a double standard in favour of. That narrows it down to two countries.
Re: Detecting and countering misuse of AI: September 2026
#237Quite the double standard here... Conventional Weapons -We identified a cell of threat actors based in northern Yemen -We identified a China-based threat actor who used Claude -We identified likely freelance Russia-based threat actors -We identified a China-based actor who used Claude’s chat -In this case, a Russia-based actor used Claude -We identified a China-based threat actor who used Claude Biological misuse We…
How is this a double standard? A cell of actors in northern Yemen building guided rockets was not working on a PhD dissertation. You are allowed to use common sense sometimes.
How do you know they weren't? Is it impossible to research any more guided rockets? Do we know what they're doing PhDs for - in China?
Re: Detecting and countering misuse of AI: September 2026
#238I’m so curious how they monitor users. Like that person the other day talking about Claude helping with their torrent stack, will Anthropic report them for breaking the law?
Yeah if was in the US i would be very careful about talking to a us based llm about reproductive health or immigration stuff. no way they arent storing stuff about you that the government can easily get to
Re: Detecting and countering misuse of AI: September 2026
#239Earlier quoted context omitted.
Our current government can't even monitor for screwworm, measles, and salads. You think they can successfully track the smartest and most individually dangerous citizens, who have been previously vetted, and work inside the system already?
What are you talking about? There have been 5 (five) cases of screwworm in the us and the us is responding by producing millions of sterile male screwworms a day as we speak.
This report says 49 confirmed cases as of a few days ago. https://www.cnn.com/2026/09/07/health/screwworm-billion-flie...
You're right about the countermeasures, but I can't help but look at 1971 (473 confirmed cases, then almost 100,000 the next year).
Re: Detecting and countering misuse of AI: September 2026
#240Meta: The potential proliferation of biological weapons is serious. Millions could die. It's easy to joke about before it happens, but try to imagine how this thread might look after the successful deployment of a biological weapon by a rogue state or non-state actor. I encourage you to take this topic seriously and contribute posts that add new information or perspectives to the discussion. (I myself think the odds…
Something close enough to this already happened, at the end of 2019. So we know what the outcome of a bioweapon will be: half the population declares that the bioweapon doesn't exist, avoiding it is "woke" and then goes out and infects themselves on purpose. Now imagine if it killed everyone who got infected instead of just a few percent.