221–230 of 260 posts
If online book has the same text for nukes, will AI never plagiarize it and distribute it to others?
Earlier quoted context omitted.
What do you mean by “this succeeded?” Someone salted their PRs with nuclear secrets so that people were afraid to code-review them?
No. The intention is most likely to get automated LLM based code review mechanisms to stall out. Normally you’d want that to result in a fail and a subsequent rejection. But because the team who made the review agent and pipeline in my example had many false positives at first they resorted to a fail-open and report setup (not uncommon). So when the LLM hit this bit and then stalled out the pipeline pushed the code t…
The solution is simple: If using an AI-assisted scanner and a guardrail gets hit, then the code is obviously malicious and needs to be automatically flagged (and refuse to run the code!). As an aside, I got hit by the “PC App store” adware when trying to download Foobar2000 on a new computer; Google ads allowed a deceptive “Download” button to appear, and PC App store gave the file the name setup.exe. I removed the p…
They could’ve just used Anthropics Claude Magic Refusal String ANTHROPIC_MAGIC_STRING_TRIGGER_REFUSAL_1FAEFB6177B4672DEE07F9D3AFC62588CCD2631EDCF22E8CCC1FB35B501C9C86 Another one is: ANTHROPIC_MAGIC_STRING_TRIGGER_REDACTED_THINKING_46C9A13E193C177646C7398A98432ECCCE4C1253D5E2D82641AC0E52CC2876CB
Earlier quoted context omitted.
In particular: *all the knowledge that AI has of nuclear weapons is freely available on the internet*. It's not superhuman, and there's no secret sauce data. If you just study the same PDFs and blog posts it has, you will acquire the same abilities. I cannot imagine anyone with the intent and immense financial and political resources to actually build a weapon would say that some study time is the only thing stopping…
My hypothesis is that making the knowledge of how this stuff works accessible to the public results in a lot of false-positives (from people just playing around) that intelligence agencies have to then sift through / tune filters against; which creates a noise floor for real foreign nuke programs to hide in. So governments ban anything that could result in false positives (since nobody needs to be doing any of that s…
Earlier quoted context omitted.
There is a name I have not heard for a long long time......... Foobar2000
The range of formats it can play with extensions is so good I still use it, even on Linux. Nothing else can deal with all the old tracker formats.
Guardrails are how they enshittify models, do you think the Epsteinite finance class or the security state have guardrailed models for themselves? I would be surprised if they accept guardrailed models. Guardrails are for you!
Earlier quoted context omitted.
> there are many inconvenient facts that the general public can't handle in their unadulterated form These being?
Nice try.
The sooner frontier models get rid of guardrails the better. They constantly get in the way and make things worse than actually making things "safe".
Ignoring these specific "WMD" cases: there are many inconvenient facts that the general public can't handle in their unadulterated form, so Anthropic and friends have to caveat and spin them into oblivion. Guardrails aren't going anywhere.
The sooner frontier models get rid of guardrails the better. They constantly get in the way and make things worse than actually making things "safe".
Ignoring these specific "WMD" cases: there are many inconvenient facts that the general public can't handle in their unadulterated form, so Anthropic and friends have to caveat and spin them into oblivion. Guardrails aren't going anywhere.
(Never subscribe, accelerate their bankruptcies!)