Live data from Hacker News

Notes on Anthropic's Computer Use Ability

composio.dev

11–20 of 108 posts

Re: Notes on Anthropic's Computer Use Ability

#11

didn't see anyone actually going into production with any of this stuff, man, this hype cycle just continues.

What is "this stuff"? Computer use was released 3 days ago and I would say the opposite is true for LLMs in general: it's overused in production and shoehorned into stuff that doesn't need it.

Re: Notes on Anthropic's Computer Use Ability

#12
post #4

At the end of the day, the fundamental dynamic here is human creativity. We are taking a tool, the LLM, and stretching it to its limit. That’s great, but that doesn’t mean we are close to AGI. It means we are AGI.

This is a step towards a human-machine hybrid world. Putting a human in the loop can do wonders. Sure, it is expensive now, but the subsequent iterations will crush it.

Re: Notes on Anthropic's Computer Use Ability

#15
I've built a couple of experiments using it so far and it has been really interesting.

On one hand, it has really helped me with prototyping incredibly fast.

On the other, it is prohibitively expensive today. Essentially you pay per click, in some cases per keystroke. I tried to get it to find a flight for me. So it opened the browser, navigated to Google Flights, entered the origin, destination etc. etc. By the time it saw a price, there had already been more than a dozen LLM calls. And then it crashed due to a rate limit issue. By the time I got a list of flight recommendations it was already $5.

But I think this is intended to be an early demo of what will be possible in the future. And they were very explicit that it's a beta: all of this feedback above will help them make it better. Very quickly it will get more efficient, less expensive, more reliable.

So overall I'm optimistic to see where this goes. There are SO many applications for this once it's working really well.

Re: Notes on Anthropic's Computer Use Ability

#17
I’m not sure if anyone else has really tried, but I’ve tested it a few times and never hit meaningful results.

1) I tried using it for QA for my SaaS but agent failed multiple times to fill out a simple form, ending with it saying the task was successfully completed.

2) It couldn’t scrape contact information from a website where the details weren’t even that hidden.

3) I also tried sending a message on Discord, but it refused, saying it couldn’t do so on someone else's behalf.

I mean, I’m excited for what the future holds, but right now, it’s not even in beta.

Re: Notes on Anthropic's Computer Use Ability

#18
I'm all for the MVP approach and shipping quickly, though I'm really surprised they went with image recognition and tooling for injecting mouse/keyboard events for automating human tasks.

I wonder why leveraging accessibility tools for this wouldn't have been a better option. Browsers and operating systems both have pretty comprehensive tooling for accessibility tools like screen readers, and the whole point of those tools is to act as a middle man to programmatically interpret and interact with what's on screen.

Re: Notes on Anthropic's Computer Use Ability

#19

What are some good use cases for this? Something that a business can be built around

There are dozens of RPA businesses. UIPath etc.

We had one that was a simple download from here and login and upload there. Having the accounting team be able to automate that versus devops is huge.

Post reply on HN