Earlier quoted context omitted.
Let's just say it's better not to risk it if there's anything you might not want them to see because they see everything. There are local models which are very capable and can be run on cloud if running on own hardware is not an option, which still gives better privacy. Second best are Chinese models. Just a few years ago I never thought I would trust Chinese software more than American, but things change so fast.
The first time a Chinese model is used against China they'll get locked down hard over there too. China is into social stability way more than the US.
Detecting and countering misuse of AI: September 2026
241–250 of 262 posts
Re: Detecting and countering misuse of AI: September 2026
#242Meta: The potential proliferation of biological weapons is serious. Millions could die. It's easy to joke about before it happens, but try to imagine how this thread might look after the successful deployment of a biological weapon by a rogue state or non-state actor. I encourage you to take this topic seriously and contribute posts that add new information or perspectives to the discussion. (I myself think the odds…
IMO you should disclose that you are an OpenAI employee if you're going to try and shape the contours of public discussion in a lecturing tone.
Re: Detecting and countering misuse of AI: September 2026
#243Earlier quoted context omitted.
Interesting document. People are vibe coding some crazy shit: "A single Claude subscriber, likely a Bamako-based independent consultant working with Mali’s state intelligence service, the “Agence Nationale de la Sécurité d’État (ANSE),” used Claude to build a system named “Lakana 360,” a population-scale domestic surveillance platform that monitors roughly 25 million SIM cards on all three of the country’s national m…
People are acting as if this was all not possible before AI showed up. Go chk some North Korean history on what is possible without having access to the cutting edge. And as Snowden already showed us, having these dumbfuck mass survellance systems is of no use cuz if it detects 600 or 6000 ppl upto something and you have 6 ppl on staff what are you going to do about it? Ask grandma for help?
Re: Detecting and countering misuse of AI: September 2026
#244> Illicit distillation Really... what makes it illicit?
Re: Detecting and countering misuse of AI: September 2026
#245Re: Detecting and countering misuse of AI: September 2026
#246The goal towards AGI and world models are a serious threat without alignment and safety guardrails .
Re: Detecting and countering misuse of AI: September 2026
#247Re: Detecting and countering misuse of AI: September 2026
#248" A variant of these viruses capable of human-to-human spread would therefore be of very high concern. Moreover, it is possible that such a variant could also have capacity for severe disease outside of the respiratory tract. Unlike other influenza variants, H5 viruses (of which this avian virus is one) often show striking brain involvement in cats, foxes, ferrets, and some human cases. A pandemic variant with such properties would be especially concerning due to its potential to increase disease severity, confuse diagnosis, and hinder treatment.
As in the first case study, this research was clearly dual use in nature. Understanding the genetic basis of these specific viral traits could help in the early identification of naturally-emerging versions of the virus—versions with the potential to cause a human pandemic" (emphasis mine)
This statement flirts with the Ron Fouchier (Netherlands) risky-grant-justification thesis, repeated ad nauseam by Peter Daszak in grant applications, who has been cut off from federal funding.
1. Premise: it would be good to surveil for & monitor viruses in nature that are near-ready to spill over to humans from nature;
2. Protocol: We will serially passage bird flu in ferrets until its virulence and/or transmissibility is high. (ferrets are treated as a model mammal stand-in for humans) Comparing genetic changes (mutations) as sequenced along the passaging pathway will tell us what to surveil for in nature.
As has long been debated in recent years, we have no idea if nature (in any given natural instance, if ever) will choose the pathway that serial passaging (in one given lab instance) produced in order to demonstrate higher virulence and/or transmissibility in humans.
Formally, Anthropic's statement recapitulates the premise only, and we don't know what protocol (the "Understanding the genetic basis of these specific viral traits" part) if any was being queried for. Whether a given regulatory regime's policy allows say for purely in silico investigation of same, for the result to be credible it would need to have been leveraging an empirically-verified (i.e. real-world) training set. Generating that training set would risk creating the pandemic that its supporting grant application tries at justifying to prevent.
But the offending prompter and similar user-LLM exchanges' potential to enable GMDs (Grants of Mass Destruction) should remind us to be very much on our guard against epistemologically bankrupt protocol outlines enabled by LLMs & their prompters' motivated reasoning.
proud disclaimer: I am an advisor to BiosafetyNow.
Re: Detecting and countering misuse of AI: September 2026
#249I get some enjoyment from keeping up with news but why do we get a post like this from openAI then immediately after get the same thing from Anthropic and vice versa like it’s a single entity deciding what the next topic is to relay to us simple folk. Exactly the same thing with the Huggingface incident. If this is so important to them why has it taken until September 2026 to start making a threat report like a week…
Not relaying to us simple folk. The message is for government simple folk, amplified and relayed by us simple folk as constituents.
The common element is lobbying, for regulatory capture, to help pull up the ladder.
They don't have to be colluding, they just have to hear the same things from the gov at the same time (as they would), then it goes in media waves beacuse journalists don't as easily get published for a story about one thing as they can if two or more examples make a pattern.
Re: Detecting and countering misuse of AI: September 2026
#250Earlier quoted context omitted.
How is this a double standard? A cell of actors in northern Yemen building guided rockets was not working on a PhD dissertation. You are allowed to use common sense sometimes.
How do you know they weren't? Is it impossible to research any more guided rockets? Do we know what they're doing PhDs for - in China?
Again... "you're allowed to use common sense"