Live data from Hacker News

Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

anthropic.com

721–730 of 758 posts

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#721

I've been saying this is coming for a long time, but my really smart SWE friend who is nevertheless not in the AI/ML space dismissed it as a stupid roundabout way of doing things. That software should just talk via APIs. No matter how much I argued regarding legacy software/websites and how much functionality is really only available through GUI, it seems some people are really put off by this type of approach. To me…

If you want an API, have Claude procedurally test actions and then write a pyautogui/pywinauto/autohotkey etc script to perform it instead. Have it auto-test to verify and classify the general applicability of each action. Repeat for all of life...

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#722

My First Experience with Claude Computer Use - It's Mind-Blowing! Just tested Claude's new Computer Use feature and had to share this simple but powerful test: My Basic Prompt: "Please: 1. Search Amazon for 3 wireless earbuds: Find price Rating Brand name 2. Make a simple Excel file 'earbuds.xlsx': Put the information in a basic table Add colors to the headers Sort by price 3. Show me the results" What blew my mind:…

This comment seems generated, or having a good marketing copy

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#723

My First Experience with Claude Computer Use - It's Mind-Blowing! Just tested Claude's new Computer Use feature and had to share this simple but powerful test: My Basic Prompt: "Please: 1. Search Amazon for 3 wireless earbuds: Find price Rating Brand name 2. Make a simple Excel file 'earbuds.xlsx': Put the information in a basic table Add colors to the headers Sort by price 3. Show me the results" What blew my mind:…

... it's almost as Claude Computer Use could (and will) just replace you entirely, huh?

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#724

I've been saying this is coming for a long time, but my really smart SWE friend who is nevertheless not in the AI/ML space dismissed it as a stupid roundabout way of doing things. That software should just talk via APIs. No matter how much I argued regarding legacy software/websites and how much functionality is really only available through GUI, it seems some people are really put off by this type of approach. To me…

>it seems some people are really put off by this type of approach As someone who has had to interact with legacy enterprise systems via RPA (screen scraping and keystroke recording) it is absolutely awful, incredibly brittle, and unmaintainable once you get past a certain level of complexity. Even when it works, performance at scale is terrible.

Everytime I imagine building this, I imagine the “it works” happypath and that I’ll get bit by a deluge of random error messages I never accounted for

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#725
post #646

Earlier quoted context omitted.

UiPath can't figure out how to make a profitable business since 2005 and we are nearing the end of this hype cycle. I am not so sure this will lead anywhere. I am a former investor in UiPath.

Attempts at commercialization in technology seem to often happen twice. First we get the much-hyped failure, and only later we get the actual thing that was promised. So many examples come to mind… RealVideo -> YouTube, Myspace -> Facebook, Laserdisc -> DVD, MP3 players -> iPod… UiPath may end up being the burned pancake, but the underlying problem they’re trying to address is immensely lucrative and possibly solvabl…

I love the “burned pancake” euphemism. Totally going to borrow this.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#726
OpenAI must be scared at this point. Anthropic is clobbering them at the high end of the market and Meta is providing free AIs at the low end. OpenAI is pretty soon going to be in the valueless middle fighting with tons of other companies for relevance

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#727
post #419

Earlier quoted context omitted.

We’ll see. Having worked in this space in the past, the technical challenges are able to overcome today with no new technology: its a business sales and regulation challenge more than a tech one.

Sometimes. In my case I have a bunch of nurses that waste a huge amount of time dealing with clerical work and tech hoops, rather than operating at the top of their license. Traditional RPAs are tough when you're dealing with VPNs, 2fa, remote desktop (in multiple ways), a variety of EHRs and scraping clinical documentation from poorly structured clinical notes or PDFs. This technology looks like it could be a game c…

Precisely why I built therapedia.io

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#728
Imagine the possibilities for cyber-crime. Surely you could program it to log in to a financial institution and transfer money. And if you had a list of user names and passwords from some large info breach? You could automate a LOT of transfers in a short amount of time...

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#729
post #531

Earlier quoted context omitted.

I've been wondering the same and started exploring building a startup around this idea. My analysis led me to the conclusion that if AI gets even just 2 orders of magnitude better over the next two years, this will be "easy" and considered table stakes. Like connecting to the internet, syncing with cloud or using printer drivers I don't think there will be a very big place for standalone next gen RPA pure plays. it m…

> if AI gets even just 2 orders of magnitude better over the next two years You realize this means '100 times better', right?

yes, thanks for pointing out the assumption here. I'm not sure how to quantify AI improvements and tbh not really up to speed on quantifiable rate of improvement from 4 to 4o to o1

100 times better seems to me in line with the bet that's justifying $250B per annum in Cap Ex (just among hyperscalers) but curious how you might project a few years out?

Having said that, my use of 100x better here applies to 100x more effective at navigating use cases not in training set, for example, as opposed to doing things that are 100x more awesome or doing them 100x more efficiently (though seemingly costs, context window and token per unit of electricity seem to continue to improve quickly)

Post reply on HN