Having played a LOT with browser use, playwright, and puppeteer (all via MCP integrations and pythonic test cases), it's incredibly clear how quickly Claude (in particular) loses the thread as it starts to interact with the browser. There's a TON of visual and contextual information that just vanishes as you begin to do anything particularly complex. In my experience, repeatedly forcing new context windows between sc…
Claude for Chrome
261–270 of 433 posts
Re: Claude for Chrome
#262Re: Claude for Chrome
#263Earlier quoted context omitted.
> make this visual infinitely repeatable I'm quite sure that was how people thought about record players and films themselves. And frankly, they were correct. The recording devices did cheapen the experience (compared to the real thing). And the digitalization of the production and distribution process cheapened it even more. Being in a gallery is a very different experience than browsing the exact same paintings on…
I don't agree with this for two different reasons. First: I don't think the analogy holds. Recording a performance is not the same as generating a recording of a performance that never happened. To be abundantly clear, I'm not making an oversimplification generalization of the form "Tool-assisted Art is not Art actually", but pointing out that there's a lot of nuance in what we consume, how we consume it and what und…
It might be true for you. But I highly doubt average people have any idea about how many or few hours were poured into the content they consume.
I've seen weebs who insists anime never utilizes rotoscope because "Japanese don't take shortcuts." My aunt questioned how anyone can make money from photo editing when a cousin of mine got married and had their wedding photos edited by a professional, because she thought it's just a few click on computer. People just don't know and they can be far off the marks in both ways.
Re: Claude for Chrome
#264Earlier quoted context omitted.
Communication by e-mail is for when you need a human decision. AI can't help with that. > Just either send each other shorter messages through another platform Why would you use another platform for sending shorter messages? E-Mail is instant and supported on all platforms.
Because email is spammed with marketing. If you send me an email at work there is a good chance I won't see it because I got 20 emails from every SaaS product news letter flooding the inbox. If you send me a message on slack there is a 100% chance I will see it.
Re: Claude for Chrome
#265I built a very similar extension [1] a couple of months ago that supports a wide range of models, including Claude, and enables them to take control of a user's browser using tools for mouse and keyboard actions, observation, etc. It's a fun little project to look at to understand how this type of thing works. It's clear to me that the tech just isn't there yet. The information density of a web page with standard rep…
It is kind of funny how the systems are set up where there often is dense and queryable information out there already for a lot of these tasks, but these are ignored in favor of the difficult challenge of brute forcing the human consumer facing ui instead of some existing api that is designed to be machine readable already. E.g. booking flights. Travel agents use software that queries all the airlines ticket inventor…
I spent the first two years of my career in the space, we joked anything invented post Michael Jackson's song Thriller wasn't present.
Re: Claude for Chrome
#266According to their own blog post, even after mitigations, the model still has an 11% attack success rate. There's still no way I would feel comfortable giving this access to my main browser. I'm glad they're sticking to a very limited rollout for now. (Sidenote, why is this page so broken? Almost everything is hidden.)
(The more interesting question will be whether they have any means to eventually make it safe. I'm pretty skeptical about it in the near term.)
Re: Claude for Chrome
#267I built a very similar extension [1] a couple of months ago that supports a wide range of models, including Claude, and enables them to take control of a user's browser using tools for mouse and keyboard actions, observation, etc. It's a fun little project to look at to understand how this type of thing works. It's clear to me that the tech just isn't there yet. The information density of a web page with standard rep…
It is kind of funny how the systems are set up where there often is dense and queryable information out there already for a lot of these tasks, but these are ignored in favor of the difficult challenge of brute forcing the human consumer facing ui instead of some existing api that is designed to be machine readable already. E.g. booking flights. Travel agents use software that queries all the airlines ticket inventor…
I’d argue that lack of interoperability is one of the biggest problems in the healthcare system here, and getting access to data through the UI intended for humans might just end up being the only feasible solution.
Re: Claude for Chrome
#268I don’t know if this will make anything better. Internet is now filled with ai generated text, picture or videos. Like we havent had enough already, it is becaming more and more. We make ai agents to talk to each other. Someone will make ai to generate a form, many other will use ai to fill that form. Even worst, some people will fill millions of forms in matter of second. What is left is the empty feeling of having…
I am starting to see this age of internet-for-robots-by-robots as our second chance to detach from those devices and start living irl again.
Re: Claude for Chrome
#269Most browser extensions you need to manually enable in incognito mode. This is an extension that should be disabled in normal mode and only enabled in incognito mode!
Just make a separate browser profile for it. That's easy in Chrome.
Re: Claude for Chrome
#270I built a very similar extension [1] a couple of months ago that supports a wide range of models, including Claude, and enables them to take control of a user's browser using tools for mouse and keyboard actions, observation, etc. It's a fun little project to look at to understand how this type of thing works. It's clear to me that the tech just isn't there yet. The information density of a web page with standard rep…
It is kind of funny how the systems are set up where there often is dense and queryable information out there already for a lot of these tasks, but these are ignored in favor of the difficult challenge of brute forcing the human consumer facing ui instead of some existing api that is designed to be machine readable already. E.g. booking flights. Travel agents use software that queries all the airlines ticket inventor…