Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Detecting and countering misuse of AI: September 2026

anthropic.com

Post reply on HN
Print view View original

101–110 of 262 posts

Re: Detecting and countering misuse of AI: September 2026

#102

Post by hnburnsy »

Quite the double standard here...

  Conventional Weapons

  -We identified a cell of threat actors based in northern Yemen
  -We identified a China-based threat actor who used Claude 
  -We identified likely freelance Russia-based threat actors
  -We identified a China-based actor who used Claude’s chat
  -In this case, a Russia-based actor used Claude
  -We identified a China-based threat actor who used Claude 

  Biological misuse

  We are withholding the names of research institutions, the   countries wherein the activity took place, and the specific biological agents or research techniques involved. The individuals implicated in these case studies are working scientists. We do not assert that they intended harm, and identifying them or their labs could expose them to harm.

Re: Detecting and countering misuse of AI: September 2026

#104

Post by [deleted] »

Molitor5901 wrote: post #99
Stevvo wrote: post #76

I don't get it. Surely if you were developing novel biological weapons, you would not use a hosted AI service where Anthropic can read what you are doing. And, why would you need to? Any chemistry graduate could make you dozens of highly effective, proven chemical weapons and explosives.

This was my thought. Anyone who has taken secondary biology or chemistry possesses the knowledge, if not at least the ability to find the knowledge, to build all sorts of nasty things. Soil from a farm on slices of potato could yield anthrax spores, this is not specialized or even esoteric knowledge. This news from Anthropic just does not seem as spectacular as I think they might want us to believe, if anything it dr…

[deleted]

Re: Detecting and countering misuse of AI: September 2026

#105

Post by atleastoptimal »

throwa356262 wrote: post #96
m-hodges wrote: post #88

> We discovered that Moonshot AI, the company that produces the Kimi family of models, silently forwarded customer requests to Claude, instead of processing them using Kimi. Moonshot then displayed Claude’s responses to users. These users thought they were using a Kimi model, but received responses from Claude instead. > DeepSeek also silently relayed exchanges to Claude without informing DeepSeek customers. > MiniMa…

DeepSeek, minimax and so on have razer thin margins but unlike openai and Anthropic they are actually making some profit. Doing this doesn't make any financial sense. Maybe Anthropic is confusing Chinese AI providers with token resellers using the same alibaba infrastructure? Or maybe something like openrouter was switching between operators depending on price/demand/availability? Also, how can Anthropic have such ac…

Anthropic is profitable now

>https://www.forbes.com/sites/jonmarkman/2026/08/17/anthropic...

Re: Detecting and countering misuse of AI: September 2026

#107

Post by ExoticPearTree »

palmotea wrote: post #98
ExoticPearTree wrote: post #29

Earlier quoted context omitted.

The Yemeni report is interesting. - How is your missile so accurate? - We're using a vibe coded app on an iPhone that does terrain matching and target finding. The thing is that OK, Anthropic may block it, but nothing says they can't use an open model hosted in a friendly country that has access to GPUs. And yes, this will most likely happen pretty soon to be able to create whatever you want without the AI provider b…

> - We're using a vibe coded app on an iPhone that does terrain matching and target finding. And that part seems entirely reasonable. It looks like the Tomahawk cruise missile did it with an 84 lb package with a 16-bit computer with 64K of memory [1] [2] and sensors. That's similar computing performance to an original IBM PC, which weighed 30 lb. The only bit of hardware an iPhone doesn't seem to have for TERCOM is a…

Or something newer, like this one: https://www.garmin.com/en-US/p/166298/#specs

Re: Detecting and countering misuse of AI: September 2026

#109

Post by gjm11 »

throwa356262 wrote: post #96
m-hodges wrote: post #88

> We discovered that Moonshot AI, the company that produces the Kimi family of models, silently forwarded customer requests to Claude, instead of processing them using Kimi. Moonshot then displayed Claude’s responses to users. These users thought they were using a Kimi model, but received responses from Claude instead. > DeepSeek also silently relayed exchanges to Claude without informing DeepSeek customers. > MiniMa…

DeepSeek, minimax and so on have razer thin margins but unlike openai and Anthropic they are actually making some profit. Doing this doesn't make any financial sense. Maybe Anthropic is confusing Chinese AI providers with token resellers using the same alibaba infrastructure? Or maybe something like openrouter was switching between operators depending on price/demand/availability? Also, how can Anthropic have such ac…

My understanding of what Anthropic are saying about this is that the labs in question aren't forwarding things to Claude to make money nor even to look better to the customers whose queries they forward to Claude but to get access to conversations between real users and Claude, which they can then use to help train their own models.

(I do not guarantee that I'm understanding right, and still less do I guarantee that what Anthropic say is actually true.)

Post reply on HN