[dead]
Responding to the next frontier of critical cyber capabilities
151–160 of 212 posts
Re: Responding to the next frontier of critical cyber capabilities
#152I'm not convinced that there's any amount of monkey-patching you to fix the problem of "we now have AI that actively needs strong containment measures lest it start coordinating in secret with other instances to do real-world damage."
In the black hat talk he says the only solution is full automated defense which is essentially hand the AI the keys. That’s checkmate right there. Literally the plot to Terminator/Skynet, but he’s right, there isn’t any other option. Offensive AI is too fast for humans.
Re: Responding to the next frontier of critical cyber capabilities
#153Earlier quoted context omitted.
What do you think should be the legal consequences? Broadly speaking. Should Sam Altman go to jail for this? If Hugging face wants to pursue OpenAI civilly, no one is stopping them.
Hugging Face, as a prominent private AI company, benefits far more from the impression of AI power this story has garnered than they stand to lose from the hack, because as has just been proven the cost of bad security by itself is zero. I think HF are a secondary beneficiary of this story. I don't expect them to take civil action (for what damages?) I expect them to play into how powerful LLMs are, how revolutionary…
If it was in fact staged I certainly see your point
Re: Responding to the next frontier of critical cyber capabilities
#154Earlier quoted context omitted.
Leaving aside any questions of Musk's credibility, he was not referring to any existing LLM, as should be evident from the 2018 date in the URL.
You're claiming that Musk is less of an AI booster now than in 2018?
No, I'm saying that you're conflating current LLMs with future ones. The 2018 date was an indication that Musk wasn't referring to any specific already-existing LLM, since there were no LLMs in 2018.
Re: Responding to the next frontier of critical cyber capabilities
#155Earlier quoted context omitted.
So they found their agents had RCE'd Artifactory once, reported it and got the fix, continued using Artifactory for their sandbox, and left it unmonitored for days despite the earlier exploits? They really do come out looking totally incompetent. I stress about my agent sandboxes all the time and the only models I run have the default heavy handed guardrails, and I don't leave them running persistently. Edit: not to…
> I stress about my agent sandboxes all the time Same here, so I ended up moving the whole dev environment (editors, agents, containers) inside a hardened QEMU/KVM VM that reaches the internet but has no route to the host, the LAN, or any other private address. I wrote a script to create such VMs and also verify network containment by scanning outward from inside the guest. Even then, I still don't feel great when ru…
Thank you very much for this helpful post!
Re: Responding to the next frontier of critical cyber capabilities
#156Earlier quoted context omitted.
What do you think should be the legal consequences? Broadly speaking. Should Sam Altman go to jail for this? If Hugging face wants to pursue OpenAI civilly, no one is stopping them.
Hugging Face, as a prominent private AI company, benefits far more from the impression of AI power this story has garnered than they stand to lose from the hack, because as has just been proven the cost of bad security by itself is zero. I think HF are a secondary beneficiary of this story. I don't expect them to take civil action (for what damages?) I expect them to play into how powerful LLMs are, how revolutionary…
> Hugging Face, as a prominent private AI company, benefits far more from the impression of AI power
They aren’t just an “AI company”. They’re the primary entry point of open weight models. If open weight models are seen as dangerous as a result of this incident, it will be bad for them. Similar to how it would be bad GitHub if open source was seen as dangerous.
Re: Responding to the next frontier of critical cyber capabilities
#157Steps we're actually taking:
- sharing the model with DoD, NSA and Israeli government
Re: Responding to the next frontier of critical cyber capabilities
#158By "cyber" they mean "cybersecurity".
The irony being that in the 90s nascent online world, "cyber" as a verb meant "cyber-sex".
Re: Responding to the next frontier of critical cyber capabilities
#159Damage done. The next frontier is getting all our shit out of reach of these companies/models/platforms and putting them back on prem.
If by “our shit” you mean our personal projects and employer projects… might i suggest this is nothing but peanuts? What happens when they get into municipal water system, state/national grid systems, refineries, traffic control, auto/air, nuclear facilities, weapons facilities, irrigation, etc? It’s really starting to feel like a bad movie how virtually no one seems to be genuinely concerned about the prospect of wh…
That’s the sort of shit I’m talking about
Re: Responding to the next frontier of critical cyber capabilities
#160[deleted]