Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude for Chrome

anthropic.com

Post reply on HN
Print view View original

161–170 of 433 posts

Re: Claude for Chrome

#161

Post by threatofrain »

parsabg wrote: post #126

I built a very similar extension [1] a couple of months ago that supports a wide range of models, including Claude, and enables them to take control of a user's browser using tools for mouse and keyboard actions, observation, etc. It's a fun little project to look at to understand how this type of thing works. It's clear to me that the tech just isn't there yet. The information density of a web page with standard rep…

> Having LLMs book flights by interacting with the DOM is sort of like having them code a web app using assembly.

The DOM is merely inexpensive, but obviously the answer can't be solely in the DOM but in the visual representation layer because that's the final presentation to the user's face.

Also the DOM is already the subject of cat and mouse games, this will just add a new scale and urgency to the problem. Now people will be putting fake content into the DOM and hiding content in the visual layer.

Re: Claude for Chrome

#162

Post by throwaway13337 »

mrs6969 wrote: post #127

I don’t know if this will make anything better. Internet is now filled with ai generated text, picture or videos. Like we havent had enough already, it is becaming more and more. We make ai agents to talk to each other. Someone will make ai to generate a form, many other will use ai to fill that form. Even worst, some people will fill millions of forms in matter of second. What is left is the empty feeling of having…

It’s wild to me that people see this as bad.

The point of the form is not in the filling. You shouldn't want to fill out a form.

If you could accomplish your task without the busywork, why wouldn’t you?

If you could interact with the world on your terms, rather than in the enshitified way monopoly platforms force on you, why wouldn't you?

And yeah, if you could consume content in the way you want, rather than the way it is presented, why wouldn’t you?

I understand the issue with AI gen slop, but slop content has been around since before AI - it's the incentives that are rotten.

Gen AI could be the greatest manipulator. It could also be our best defense against manipulation. That future is being shaped right now. It could go either way.

Let's push for the future where the individual has control of the way they interact.

Re: Claude for Chrome

#164

Post by epolanski »

mrs6969 wrote: post #127

I don’t know if this will make anything better. Internet is now filled with ai generated text, picture or videos. Like we havent had enough already, it is becaming more and more. We make ai agents to talk to each other. Someone will make ai to generate a form, many other will use ai to fill that form. Even worst, some people will fill millions of forms in matter of second. What is left is the empty feeling of having…

I am starting to see this age of internet-for-robots-by-robots as our second chance to detach from those devices and start living irl again.

Re: Claude for Chrome

#165

Post by carlosjobim »

chankstein38 wrote: post #141
mrs6969 wrote: post #127

I don’t know if this will make anything better. Internet is now filled with ai generated text, picture or videos. Like we havent had enough already, it is becaming more and more. We make ai agents to talk to each other. Someone will make ai to generate a form, many other will use ai to fill that form. Even worst, some people will fill millions of forms in matter of second. What is left is the empty feeling of having…

I was just talking about this same thing with someone. It's like emails. If, instead of writing an email, I gave AI some talking points and then told it to generate an email around that, then the person that I sent it to has AI summarize it.... What's the point of email? Why would we still use email at all? Just either send each other shorter messages through another platform or let LLMs do the entire communication f…

Communication by e-mail is for when you need a human decision. AI can't help with that.

> Just either send each other shorter messages through another platform

Why would you use another platform for sending shorter messages? E-Mail is instant and supported on all platforms.

Re: Claude for Chrome

#166

Post by raincole »

rpowers wrote: post #154
mrs6969 wrote: post #127

I don’t know if this will make anything better. Internet is now filled with ai generated text, picture or videos. Like we havent had enough already, it is becaming more and more. We make ai agents to talk to each other. Someone will make ai to generate a form, many other will use ai to fill that form. Even worst, some people will fill millions of forms in matter of second. What is left is the empty feeling of having…

I've had this conversation a couple of times now. If AI can just scan a video and provide bullet points, what's the point of the video at all? Same with UI/UX in general. Without real users, then it starts to feel meaningless. Some media is cool because you know it was really difficult to put it together or obtain the footage. I think of Tom Cruise and his stunts in Mission Impossible as an example. They add to the s…

> make this visual infinitely repeatable

I'm quite sure that was how people thought about record players and films themselves.

And frankly, they were correct. The recording devices did cheapen the experience (compared to the real thing). And the digitalization of the production and distribution process cheapened it even more. Being in a gallery is a very different experience than browsing the exact same paintings on instagram.

Re: Claude for Chrome

#167

Post by jonplackett »

threatofrain wrote: post #161
parsabg wrote: post #126

I built a very similar extension [1] a couple of months ago that supports a wide range of models, including Claude, and enables them to take control of a user's browser using tools for mouse and keyboard actions, observation, etc. It's a fun little project to look at to understand how this type of thing works. It's clear to me that the tech just isn't there yet. The information density of a web page with standard rep…

> Having LLMs book flights by interacting with the DOM is sort of like having them code a web app using assembly. The DOM is merely inexpensive, but obviously the answer can't be solely in the DOM but in the visual representation layer because that's the final presentation to the user's face. Also the DOM is already the subject of cat and mouse games, this will just add a new scale and urgency to the problem. Now peo…

It also surely leaves more room for prompt injection that the user can’t see

Re: Claude for Chrome

#168

Post by panarky »

jascha_eng wrote: post #146
aliljet wrote: post #22

Having played a LOT with browser use, playwright, and puppeteer (all via MCP integrations and pythonic test cases), it's incredibly clear how quickly Claude (in particular) loses the thread as it starts to interact with the browser. There's a TON of visual and contextual information that just vanishes as you begin to do anything particularly complex. In my experience, repeatedly forcing new context windows between sc…

I have built a custom "deep research" internally that uses puppeteer to find business information, tech stack and other information about a company for our sales team. My experience was that giving the LLM a very limited set of tools and no screenshots worked pretty damn well. Tbf for my use case I don't need more interactivity than navigate_to_url and click_link. Each tool returning a text version of the page and th…

Just shoving everything into one context fails after just a few turns.

I've had more success with a hierarchy of agents.

A supervisor agent stays focused on the main objective, and it has a plan to reach that objective that's revised after every turn.

The supervisor agent invokes a sub-agent to search and select promising sites, and a separate sub-sub-agent for each site in the search results.

When navigating a site that has many pages or steps, a sub-sub-sub-agent for each page or step can be useful.

The sub-sub-sub-agent has all the context for that page or step, and it returns a very short summary of the content of that page, or the action it took on that step and the result to the sub-sub-agent.

The sub-sub-agents return just the relevant details to their parent, the sub-agent.

That way the supervisor agent can continue for many turns at the top level without exhausting the context window or losing the thread and pursuing its own objective.

Re: Claude for Chrome

#169

Post by Blahah »

rpowers wrote: post #154
mrs6969 wrote: post #127

I don’t know if this will make anything better. Internet is now filled with ai generated text, picture or videos. Like we havent had enough already, it is becaming more and more. We make ai agents to talk to each other. Someone will make ai to generate a form, many other will use ai to fill that form. Even worst, some people will fill millions of forms in matter of second. What is left is the empty feeling of having…

I've had this conversation a couple of times now. If AI can just scan a video and provide bullet points, what's the point of the video at all? Same with UI/UX in general. Without real users, then it starts to feel meaningless. Some media is cool because you know it was really difficult to put it together or obtain the footage. I think of Tom Cruise and his stunts in Mission Impossible as an example. They add to the s…

Lots of people really prefer watching videos. I'm very grateful that tools exist for those of us who don't.

Re: Claude for Chrome

#170

Post by [deleted] »

r0ze-at-hn wrote: post #107

TikTokification of the browser by AI is the killer feature, not writing an email. When on a page it automatically suggests the next site(s) to visit based on my history and the page I am on. And when I say killer, this kills google search by pivoting away from the urlbar and provides a new space to put ads. Spent years in the browser space, on Chrome, DDG, Blackberry and more developing browsers, prototype browser an…

[deleted]
Post reply on HN