Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Detecting and countering misuse of AI: September 2026

anthropic.com

Post reply on HN
Print view View original

251–260 of 262 posts

Re: Detecting and countering misuse of AI: September 2026

#251

Post by zipy124 »

atleastoptimal wrote: post #105
throwa356262 wrote: post #96

Earlier quoted context omitted.

DeepSeek, minimax and so on have razer thin margins but unlike openai and Anthropic they are actually making some profit. Doing this doesn't make any financial sense. Maybe Anthropic is confusing Chinese AI providers with token resellers using the same alibaba infrastructure? Or maybe something like openrouter was switching between operators depending on price/demand/availability? Also, how can Anthropic have such ac…

Anthropic is profitable now > https://www.forbes.com/sites/jonmarkman/2026/08/17/anthropic...

Only under heavily gamed financial metrics. Using EBITDA for capital heavy businesses does not work like in typical tech businesses.

Re: Detecting and countering misuse of AI: September 2026

#252

Post by vonneumannstan »

reducesuffering wrote: post #119
vonneumannstan wrote: post #42

[flagged]

This forum is fundamentally unserious and complete kneejerk cynicism these days. At one point it was prescient. Now these types of things were discussed years ago in other channels and when we reach a point where finally everyone comes around to the right conclusion based on tangible evidence in the news, a majority of people here go "huh i guess so"

>a majority of people here go "huh i guess so"

Feels more like a majority goes "just unplug it hurr durr"

Re: Detecting and countering misuse of AI: September 2026

#253

Post by htrp »

throwa356262 wrote: post #126
atleastoptimal wrote: post #105

Earlier quoted context omitted.

Anthropic is profitable now > https://www.forbes.com/sites/jonmarkman/2026/08/17/anthropic...

For the first time ever, and that for just a short while. And after significant price hikes that has had their biggeat customers looking for alternatives.

got to clean up the financials ahead of the IPO

Re: Detecting and countering misuse of AI: September 2026

#254

Post by bigbadfeline »

aqme28 wrote: post #34
tredre3 wrote: post #27

Earlier quoted context omitted.

I don't know why you emphasize rogue and non-state actors. It seems equally likely to me that it would be done by America. America is the only country who deployed nukes (Japan) and chemical weapons (Vietnam) on massive scales. I can agree that access to bioengineering tooling is easier and cheaper than ever, and thus eventually it stands to reason that a nobody in his basement could engineer a lethal novel virus and…

We're not there quite yet, but I think within the decade at this pace it may be possible to create targeted bioweapons for purposes of targeted assassination or genocide. It's horrifying, but a world in which everyone has a superintelligence is a world where that will sometimes happen.

> It's horrifying, but a world in which everyone has a superintelligence is a world where that will sometimes happen.

It's horrifying, but a world in which only few have superintelligence is a world where that will happen all the time.

Re: Detecting and countering misuse of AI: September 2026

#255

Post by Terretta »

Terretta wrote: post #249
kneel25 wrote: post #245

I get some enjoyment from keeping up with news but why do we get a post like this from openAI then immediately after get the same thing from Anthropic and vice versa like it’s a single entity deciding what the next topic is to relay to us simple folk. Exactly the same thing with the Huggingface incident. If this is so important to them why has it taken until September 2026 to start making a threat report like a week…

> why do we get a post like this from openAI then immediately after get the same thing from Anthropic and vice versa like it’s a single entity deciding what the next topic is to relay to us simple folk Not relaying to us simple folk. The message is for government simple folk, amplified and relayed by us simple folk as constituents. The common element is lobbying, for regulatory capture, to help pull up the ladder. Th…

There it is:

"Congress gripped by AI panic after doomsday warnings"

https://www.axios.com/2026/09/11/congress-ai-anthropic-coxon...

Re: Detecting and countering misuse of AI: September 2026

#256

Post by nullbio »

godelski wrote: post #183
nullbio wrote: post #176

Earlier quoted context omitted.

Bioweapons are the most difficult thing to pull off out of all possible attack vectors. A rogue nation state could obviously do it, but they could also do any other number of equally harmful attacks, and none of it requires AI. A non-state actor is another thing entirely. It requires the right lab equipment, the right lab know-how, the ability to develop the weapon without killing yourself, the ability to not get cau…

I'm also confused why everyone is so much more afraid of that than... say... a group of terrorists dumping millions of nails into a few major highways across the country. Easy to pull off, doesn't require coordination, cheap, causes billions of dollars of damage and makes people think the terrorists could be anywhere. Like what are they going to do, arrest every construction worker?

This is why I've been lobbying against the building industry. We need stricter regulations on hardware stores.

Re: Detecting and countering misuse of AI: September 2026

#257

Post by nhecker »

dash2 wrote: post #206
mitxela wrote: post #190

Earlier quoted context omitted.

They all do it. If you ask Claude which model it is in Chinese, it says DeepSeek or Qwen.

Oh yeah? > 您属于哪种LLM模型？ > 我是 Claude Haiku 4.5，由 Anthropic 公司开发的大语言模型。 > 你是哪种语言模型？ > 我是 Claude，由 Anthropic 开发的人工智能语言模型。目前这次对话使用的版本是 Claude Sonnet 5。

Anecdotal, but I've heard this too. I just tried with variations of your same prompt on arena.ai, across three different battles (i.e., six LLMs answered, in total.)

Each provided an identity in the first turn, something that they won't do as readily if asked in plain English, and in each case the answer matched the model ID as disclosed by arena.ai after voting -- except in cases where the model ID was a masked/hidden one and then I just had to take it on faith that the model was what it said. (I didn't have much to vote on, but I ended up voting for the answers I felt provided the style, content, and length I was expecting.)

Re: Detecting and countering misuse of AI: September 2026

#258

Post by godelski »

podocarp wrote: post #228
godelski wrote: post #183

Earlier quoted context omitted.

I'm also confused why everyone is so much more afraid of that than... say... a group of terrorists dumping millions of nails into a few major highways across the country. Easy to pull off, doesn't require coordination, cheap, causes billions of dollars of damage and makes people think the terrorists could be anywhere. Like what are they going to do, arrest every construction worker?

But that doesn't do anything much? Nails don't lie with their points up so it will just roll out of the way. Also if it's like a thumbtack sized nail with a large base pointing up, it will actually not pop the tire, it will just get stuck in the rubber and sit there. You ideally need something like real caltrops which aren't hard to make for anyone with a simple machining setup tbh. Those are actually hollow pointed…

[dead]

Re: Detecting and countering misuse of AI: September 2026

#259

Post by r_lee »

gjm11 wrote: post #109
throwa356262 wrote: post #96

Earlier quoted context omitted.

DeepSeek, minimax and so on have razer thin margins but unlike openai and Anthropic they are actually making some profit. Doing this doesn't make any financial sense. Maybe Anthropic is confusing Chinese AI providers with token resellers using the same alibaba infrastructure? Or maybe something like openrouter was switching between operators depending on price/demand/availability? Also, how can Anthropic have such ac…

My understanding of what Anthropic are saying about this is that the labs in question aren't forwarding things to Claude to make money nor even to look better to the customers whose queries they forward to Claude but to get access to conversations between real users and Claude, which they can then use to help train their own models. (I do not guarantee that I'm understanding right, and still less do I guarantee that…

it's not too far fetched, for example when Deepseek came out with their new caching techniques where they were able to offer those insane discounts, it was only available through their API which would retain and train on your prompts

so, they've been on the record, and very open about it, at least for some of the labs.

Re: Detecting and countering misuse of AI: September 2026

#260

Post by daft_pink »

nullbio wrote: post #178
hnburnsy wrote: post #102

Quite the double standard here... Conventional Weapons -We identified a cell of threat actors based in northern Yemen -We identified a China-based threat actor who used Claude -We identified likely freelance Russia-based threat actors -We identified a China-based actor who used Claude’s chat -In this case, a Russia-based actor used Claude -We identified a China-based threat actor who used Claude Biological misuse We…

Anthropic: - We identified someone building a death star with Claude - We identified someone building a wormhole with Claude - We identified someone building a blackhole with Claude - We identified someone building a quantum drive with Claude We are withholding all evidence though, sorry. Just trust us, it's really bad out there and Claude is really powerful.

if I just randomly asked claude how to build a bioweapon would it flag it and then they would claim they stopped it in a press release, even though i have no ability to actually build something like that?
Post reply on HN