151–160 of 290 posts
AI companies: Agentic AI has been weaponized. AI models are now being used to perform sophisticated cyberattacks, not just advise on how to carry them out. We need regulation to mitigate these risks. The same AI companies: here's a way to give AI full executable access to your personal data, enjoy!
Earlier quoted context omitted.
IMO the way we need to be thinking about prompt injection is that any tool can call any other tool. When introducing a tool with untrusted output (that is to say, pretty much everything, given untrusted input) you’re exposing every other tool as an attack vector. In addition the LLMs themselves are vulnerable to a variety of attacks. I see no mention of prompt injection from Anthropic or OpenAI in their announcements…
Anthropic talked about prompt injection a bunch in the docs for their web fetch tool feature they released today: https://docs.anthropic.com/en/docs/agents-and-tools/tool-use... My notes: https://simonwillison.net/2025/Sep/10/claude-web-fetch-tool/
Earlier quoted context omitted.
It’s not that simple. That would result in a brittle solution and/or cat and mouse game. The text that goes into a prompt is vast when you consider common web and document searches are. It’s going to be a long road to good security requiring multiple levels of defense and ongoing solutions.
I assumed beeflet was being sarcastic. There’s no way it was a serious suggestion. Holy shit, am I wrong?
Wow this is dangerous. I wonder how many people are going to turn this on without understanding the full scope of the risks it opens them up to. It comes with plenty of warnings, but we all know how much attention people pay to those. I'm confident that the majority of people messing around with things like MCP still don't fully understand how prompt injection attacks work and why they are such a significant threat.
Well, isn't it like Yolo mode from Claude Code that we've been using, without worry, locally for months now? I truly think that Yolo mode is absolutely fantastic, while dangerous, and I can't wait to see what the future holds there.
Earlier quoted context omitted.
You still have to be pretty careful it doesn't have access to any API keys it could decide to exfiltrate...
How would it have access to API keys? You don’t put those in your git repo, do you?
AI companies: Agentic AI has been weaponized. AI models are now being used to perform sophisticated cyberattacks, not just advise on how to carry them out. We need regulation to mitigate these risks. The same AI companies: here's a way to give AI full executable access to your personal data, enjoy!
time to explore. isn't this HACKER news? get hacking. ffs
I've been waiting for ChatGPT to get MCPs, this is pretty sweet. Next step is a local system control plane MCP to give it sandbox access/permission requests so I can use it as an agent from the web.
Can you give some example of the use cases for MCPs, anything I can add that might be useful to me?
Earlier quoted context omitted.
It’s not that simple. That would result in a brittle solution and/or cat and mouse game. The text that goes into a prompt is vast when you consider common web and document searches are. It’s going to be a long road to good security requiring multiple levels of defense and ongoing solutions.
If only we had a reliable way to detect that a poster was being sarcasm or facetious on the Internet.
Earlier quoted context omitted.
Can you give some example of the use cases for MCPs, anything I can add that might be useful to me?
The most useful ones are memory and sequential thinking. Imo
Chatgpt asks for a host for the mcp server.
All the MCPS I find give a config like
```{ "mcpServers": { "sequential-thinking": { "command": "npx", "args": [ "-y", "@modelcontextprotocol/server-sequential-thinking" ] } } }```
I'm confused and I'm a developer