Manifest V2 is too dangerous like Ublock Origin but LLM that can control your browser isn’t?
Claude for Chrome
71–80 of 433 posts
Re: Claude for Chrome
#72> Malicious actors can hide instructions in websites, emails, and documents that trick AI into taking harmful actions without your knowledge, including: > * Accessing your accounts or files > * Sharing your private information > * Making purchases on your behalf > * Taking actions you never intended This should really be at the top of the page and not one full screen below the "Try" button.
Can somebody explain this security problem to me please.
How is there not an actual deterministic traditionally programmed layer in-between the LLM and whatever it wants to do? That layer shows you exactly what changes it is going to apply and it is going to ask you for confirmation.
What is the actual problem here?
Re: Claude for Chrome
#73Earlier quoted context omitted.
It's insane how we're throwing out decades of security research because it's slightly annoying to have to write your own emails.
My theory is that the average user of an LLM is close enough to the average user of a computer and I've found that the general consensus is that security practices are "annoying" and "get in the way". The same kind of user who hates anything MFA and writes their password on a sticky note that they stick to their monitor in the office.
it has been revelatory to me to realize that this is how most people want to interact with computers.
i want a computer to be predictable and repeatable. sometimes, i experience behavior that is surprising. usually this is an indication that my mental model does not match the computer model. in these cases, i investigate and update my mental model to match the computer.
most people are not willing to adjust their mental model. they want the machine to understand what they mean, and they're willing to risk some degree of lossy mis-communication which also corrupts repeatability.
maybe i'm naive but it wasn't until recently that i realized predictable determinism isn't actually something that people universally want from their personal computers.
Re: Claude for Chrome
#74Earlier quoted context omitted.
When we felt we were getting close to flight, people were jumping off buildings in wing suits. And then, the Wright Bros. cracked the problem. Rocketry, Apollo... Same thing here. And it's bound to have the same consequences, both good and bad. Let's not forget how dangerous the early web was with all of the random downloadables and popups that installed exe files. Evolution finds a way, but it leaves a mountain of b…
> When we felt we were getting close to flight, people were jumping off buildings in wing suits. And then, the Wright Bros. cracked the problem. Yeah they cracked the problem with a completely different technology. Letting LLMs do things in a browser autonomously is insane. > Let's not forget how dangerous the early web was with all of the random downloadables and popups that installed exe files. And now we are unwin…
you also have to be a real asshole to send an email written by AI, at least if you speak the language fluently. If you can't take the time to choose your words what gives you the right to expect me to spend my precious life reading them?
if you send AI generated emails, please punch yourself in the face
Re: Claude for Chrome
#75Earlier quoted context omitted.
It's insane how we're throwing out decades of security research because it's slightly annoying to have to write your own emails.
Then it's a great time to be a LLM security researcher then. Think about all the issues that attackers can do with these LLMs in the browser: * Mislead agents to paying for goods with the wrong address * Crypto wallets drained because the agent was told to send it to another wallet but it sent it to the wrong one. * Account takeover via summarization, because a hidden comment told the agent additional hidden instruct…
[deleted]
Re: Claude for Chrome
#76Earlier quoted context omitted.
It's insane how we're throwing out decades of security research because it's slightly annoying to have to write your own emails.
When we felt we were getting close to flight, people were jumping off buildings in wing suits. And then, the Wright Bros. cracked the problem. Rocketry, Apollo... Same thing here. And it's bound to have the same consequences, both good and bad. Let's not forget how dangerous the early web was with all of the random downloadables and popups that installed exe files. Evolution finds a way, but it leaves a mountain of b…
The problem is exactly that we seem to have forgotten how dangerous the early web was and are blithely reproducing that history.
Re: Claude for Chrome
#77Not sure if its only me, but most of the texts in this page aren't showing up. https://i.imgur.com/E4HloO7.png
The blog works for me: https://www.anthropic.com/news/claude-for-chrome
Re: Claude for Chrome
#78Earlier quoted context omitted.
It's insane how we're throwing out decades of security research because it's slightly annoying to have to write your own emails.
With regards to llm injection, we sorta need the cat and mouse games to play out a bit, no? I have my concerns but I'm not ready to throw out the baby with the bathwater. You could never release an OS if "no zero days" was a requirement. Every piece of software we use has and will have its vulnerabilities (see Apple's recent RCE), we play the arms race and things look asymptotically fine. This seems to be the case in…
At the same time, manufacturers do not release operating systems with extremely obvious flaws that have (atleast so far) no reasonable guardrails and pretend that they are the next messiah.
Re: Claude for Chrome
#79Earlier quoted context omitted.
No, it's because big tech has taken control of our data and locked it all down so we don't have control over it. AI browser automation is going to blow open all these militarized containers that use our own data and networks against us with the fig leaf of supposed security. I'm looking forward to the revival of personal data mashups like the old Yahoo Pipes.
> AI browser automation is going to blow open all these militarized containers that use our own data against us. I'm not sure what you mean by this. Do you mean that AI browser automation is going to give us back control over our data? How? Aren't you starting a remote desktop session with Anthropic everytime you open your browser?
There's a million ways. Just off the top of my head: unified calendars, contacts and messaging across Google, Facebook, Microsoft, Apple, etc. The agent figures out which platform to go to and sends the message without you caring about the underlying platform.
Re: Claude for Chrome
#80Having played a LOT with browser use, playwright, and puppeteer (all via MCP integrations and pythonic test cases), it's incredibly clear how quickly Claude (in particular) loses the thread as it starts to interact with the browser. There's a TON of visual and contextual information that just vanishes as you begin to do anything particularly complex. In my experience, repeatedly forcing new context windows between sc…
Same. When I try to get it to do a simple loop (eg take screenshot, click next, repeat) it'll work for about five iterations (out of a hundred or so desired) then say, "All done, boss!" I'm hoping Anthropic's browser extension is able to do some of the same "tricks" that Claude Code uses to gloss over these kinds of limitations.
Hopefully one of those "tricks" involves training a model on examples of browser use.