Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Detecting and countering misuse of AI: September 2026

anthropic.com

Post reply on HN
Print view View original

191–200 of 262 posts

Re: Detecting and countering misuse of AI: September 2026

#191

Post by chvid »

throwa356262 wrote: post #96
m-hodges wrote: post #88

> We discovered that Moonshot AI, the company that produces the Kimi family of models, silently forwarded customer requests to Claude, instead of processing them using Kimi. Moonshot then displayed Claude’s responses to users. These users thought they were using a Kimi model, but received responses from Claude instead. > DeepSeek also silently relayed exchanges to Claude without informing DeepSeek customers. > MiniMa…

DeepSeek, minimax and so on have razer thin margins but unlike openai and Anthropic they are actually making some profit. Doing this doesn't make any financial sense. Maybe Anthropic is confusing Chinese AI providers with token resellers using the same alibaba infrastructure? Or maybe something like openrouter was switching between operators depending on price/demand/availability? Also, how can Anthropic have such ac…

Maybe there is some truth in that reselling Claude subscriptions/trials/api bundles via third parties breaks Anthropic's ToS. The rest is putting a maximum spin on it in order to achieve the political goal of banning Chinese AI. Anthropic is a highly ideological company and they are convinced that they are just in what they pursuit.

Re: Detecting and countering misuse of AI: September 2026

#192

Post by 0xDEAFBEAD »

classified wrote: post #162
stuaxo wrote: post #153

Earlier quoted context omitted.

Damn, it's not even 1am and I got my first FFS of the day. Is end of days cultism a prerequisite to working at an LLM company? I miss the optimism of 20 years ago.

It's the usual propaganda. They want to insinuate how powerful their models are and achieve government regulation. Win-win.

Is this belief falsifiable? Consider e.g. the fact that Daniel Kokotajlo left OpenAI due to his concerns even though it meant leaving equity on the table.

Re: Detecting and countering misuse of AI: September 2026

#193

Post by nullc »

areoform wrote: post #155
tedsanders wrote: post #17

Meta: The potential proliferation of biological weapons is serious. Millions could die. It's easy to joke about before it happens, but try to imagine how this thread might look after the successful deployment of a biological weapon by a rogue state or non-state actor. I encourage you to take this topic seriously and contribute posts that add new information or perspectives to the discussion. (I myself think the odds…

Hey Ted, I invite you to read the front matter and the report for yourself. Because from where I'm standing, in this report, Anthropic is advertising that they blocked real research to make better painkillers and study a neglected tropical disease. Anthropic and OpenAI were founded by people who wanted to use AI to do good, and one of the causes I've heard many different founders talk about is ending disease. This re…

> Anthropic and OpenAI were founded by people who wanted to use AI to do good

I think Anthropic was founded by people who wanted to control how other people get to use AI, and define doing so as the highest good possible. Much like the good intent of german's national socialists in applying the latest evolutionary science...

Re: Detecting and countering misuse of AI: September 2026

#195

Post by tomjen3 »

throwa356262 wrote: post #96
m-hodges wrote: post #88

> We discovered that Moonshot AI, the company that produces the Kimi family of models, silently forwarded customer requests to Claude, instead of processing them using Kimi. Moonshot then displayed Claude’s responses to users. These users thought they were using a Kimi model, but received responses from Claude instead. > DeepSeek also silently relayed exchanges to Claude without informing DeepSeek customers. > MiniMa…

DeepSeek, minimax and so on have razer thin margins but unlike openai and Anthropic they are actually making some profit. Doing this doesn't make any financial sense. Maybe Anthropic is confusing Chinese AI providers with token resellers using the same alibaba infrastructure? Or maybe something like openrouter was switching between operators depending on price/demand/availability? Also, how can Anthropic have such ac…

I assume these companies are backed by the Chinese state.

Re: Detecting and countering misuse of AI: September 2026

#196

Post by tomjen3 »

0xDEAFBEAD wrote: post #192
classified wrote: post #162

Earlier quoted context omitted.

It's the usual propaganda. They want to insinuate how powerful their models are and achieve government regulation. Win-win.

Is this belief falsifiable? Consider e.g. the fact that Daniel Kokotajlo left OpenAI due to his concerns even though it meant leaving equity on the table.

There will always be people leaving companies because they don't believe in them anymore.

Re: Detecting and countering misuse of AI: September 2026

#197

Post by not2b »

They seem to be mixing together things that are actually harmful to the public, with things that are merely harmful to their business model (which is their claim that they can grab whatever data that they want regardless of the wishes of the owners of the data and use it to improve their models, but competitors can't do that to them).

Re: Detecting and countering misuse of AI: September 2026

#198

Post by xscott »

mitxela wrote: post #190
KronisLV wrote: post #127

Earlier quoted context omitted.

I’ve seen the supposed Kimi thinking output yap about Anthropic’s guidelines and whatnot on many occasions - could also be the result of distillation, but also that straight up being Claude’s output. To be honest I've also gotten Kimi to do an okay proof of concept for SQLi though mostly in a more defensive role, like "Let's see how big of a problem this is", while Claude complained about CVP on the same task.

They all do it. If you ask Claude which model it is in Chinese, it says DeepSeek or Qwen.

I had Muse Glimmer (from Meta / Facebook) quoting OpenAI's safety guidelines to me, and I had Poolside's Laguna (a smaller US company) with thinking traces about obeying Chinese law.

Both of those are local models, and I didn't provide them tools to access the internet to call other models. None of this is proof of anything, but it is suggestive.

Re: Detecting and countering misuse of AI: September 2026

#199

Post by swat535 »

mdeeks wrote: post #66
nbhkvl wrote: post #61

Earlier quoted context omitted.

[flagged]

He doesn't seem to be a marking guy. Also you haven't given a reason not to take his words seriously

You don’t think employees with an incentive to profit financially by imposing government regulations on competition should be questioned?

Re: Detecting and countering misuse of AI: September 2026

#200

Post by [deleted] »

Terr_ wrote: post #157
analognoise wrote: post #152

Earlier quoted context omitted.

Our current government can't even monitor for screwworm, measles, and salads. You think they can successfully track the smartest and most individually dangerous citizens, who have been previously vetted, and work inside the system already?

Let's be careful to separate capable-of from motivated-to. Those three "can't even monitor" situations can be traced to blocs with both (A) a financial profit if they succeed and (B) some non-clandestine political clout to sabotage/discontinue things.

[deleted]
Post reply on HN