Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

anthropic.com

Post reply on HN
Print view View original

531–540 of 758 posts

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#531

Post by arach »

monkeydust wrote: post #378
aduffy wrote: post #374

Earlier quoted context omitted.

This has existed for a long time, it's called "RPA" or Robotic Process Automation. The biggest incumbent in this space is UiPath, but there are a host of startups and large companies alike that are tackling it. Most of the things that RPA is used for can be easily scripted, e.g. download a form from one website, open up Adobe. There are a lot of startups that are trying to build agentic versions of RPA, I'm glad to s…

Exactly. I have been wondering for a while how GenAI might upend RPA providers guess this might be the answer.

I've been wondering the same and started exploring building a startup around this idea. My analysis led me to the conclusion that if AI gets even just 2 orders of magnitude better over the next two years, this will be "easy" and considered table stakes. Like connecting to the internet, syncing with cloud or using printer drivers

I don't think there will be a very big place for standalone next gen RPA pure plays. it makes sense that companies that are trying to deliver value would implement capabilities this. Over time, I expect some conventions/specs will emerge. Either Apple/Google or Anthropic/OpenAI are likely to come up with an implementation that everyone aligns on

In other words, I agree

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#533

Post by chillfox »

cootsnuck wrote: post #337
diggan wrote: post #126

Earlier quoted context omitted.

> The older/bigger GPT4 runs at $30/$60 and peforms about on par with GPT4o-mini which costs only $0.15/$0.60. I don't think GPT-4o Mini has comparable performance to GPT-4 at all, where are you finding the benchmarks claiming this? Everywhere I look says GPT-4 is more powerful, but GPT-4o Mini is most cost-effective, if you're OK with worse performance. Even OpenAI themselves about GPT-4o Mini: > Our affordable and…

Just switch out gpt-4o-mini for gpt-4o, the point stands. Across the board, these foundational model companies have comparable, if not more powerful, models that are cheaper than their older models. OpenAI's own words: "GPT-4o is our most advanced multimodal model that’s faster and cheaper than GPT-4 Turbo with stronger vision capabilities." gpt-4o: $2.50 / 1M input tokens $10.00 / 1M output tokens gpt-4-turbo: $10.0…

I found that gpt-4-turbo beat gpt-4o pretty consistently for coding tasks, but claude-3.5-sonnet beat both of them, so it's what I have been using most of the time. gpt-4o-mini is adequate for summarizing text.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#534

Post by SoftTalker »

falcor84 wrote: post #492
xxpor wrote: post #472

Earlier quoted context omitted.

I can see it now, Claude generating expect scripts. 1994 and 2024 will be fully joined.

The big thing I expect at the next level is in using Claude to first generate UI-based automation based on an end user's instructions, then automatically defining a suite of end-to-end tests, confirming with the user "is this how it should work?", and then finally using this suite to reimplement the flow from first principles. I know we're still a bit far from there, but I don't see a particular hurdle that strikes m…

But does it do any better at soliciting the surprise requirements from the user, who after confirming that everything works, two months later reports a production bug because the software isn't correctly performing the different reqirements on the first Tuesday of each quarter that you never knew about.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#535

Post by SoftTalker »

tkellogg wrote: post #410
aduffy wrote: post #374

Earlier quoted context omitted.

This has existed for a long time, it's called "RPA" or Robotic Process Automation. The biggest incumbent in this space is UiPath, but there are a host of startups and large companies alike that are tackling it. Most of the things that RPA is used for can be easily scripted, e.g. download a form from one website, open up Adobe. There are a lot of startups that are trying to build agentic versions of RPA, I'm glad to s…

Honestly, this is going to be huge for healthcare. There's an incredible amount of waste due to incumbent tech making interoperability difficult.

> There's an incredible amount of waste due to incumbent tech making interoperability difficult.

So the solution to that is to add another layer of complex AI tech on top of it?

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#536

Post by SoftTalker »

miki123211 wrote: post #525
tkellogg wrote: post #410

Earlier quoted context omitted.

Honestly, this is going to be huge for healthcare. There's an incredible amount of waste due to incumbent tech making interoperability difficult.

Healthcare has the extra complication of HIPAA / equivalent local laws, and institutions being extremely unwilling to process patient data on devices they don't directly control. I don't think this is going to work in that industry until local models get good enough to do it, and small enoguh to be affordable to hospitals.

That industry only thinks it controls its devices. Crowdstrike showed there are many bridges over that moat.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#537

Post by nwnwhwje »

accrual wrote: post #281
gzer0 wrote: post #182

One of the funnier things during training with the new API (which can control your computer) was this: "Even while recording these demos, we encountered some amusing moments. In one, Claude accidentally stopped a long-running screen recording, causing all footage to be lost. Later, Claude took a break from our coding demo and began to peruse photos of Yellowstone National Park." [0] https://x.com/AnthropicAI/status/1…

Seeing models act as though they have agency gives me goosebumps (e.g. seeking out photos of Yellowstone for fun). LLMs don't yet have a concept of true intent or agency, but it's wild to think of them acquiring it. I have been playing with Mindcraft which lets models interact with Minecraft through the bot API and one of them started saying things like "I want to place some cobblestone there" and then later more gen…

They predict (correctly) that a human will slack off. It is just more prediction engine stuff.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#539

Post by voidmain0001 »

iwontberude wrote: post #453
aduffy wrote: post #374

Earlier quoted context omitted.

This has existed for a long time, it's called "RPA" or Robotic Process Automation. The biggest incumbent in this space is UiPath, but there are a host of startups and large companies alike that are tackling it. Most of the things that RPA is used for can be easily scripted, e.g. download a form from one website, open up Adobe. There are a lot of startups that are trying to build agentic versions of RPA, I'm glad to s…

UiPath can't figure out how to make a profitable business since 2005 and we are nearing the end of this hype cycle. I am not so sure this will lead anywhere. I am a former investor in UiPath.

It didn’t help that UIPath forced a subscription model and “cloud orchestrator” on all users and many of which needed neither. They got greedy. We ditched it.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#540

Post by nwnwhwje »

frankdenbow wrote: post #429
marsh_mellow wrote: post #19

Anthropic blog post outlining the research process: https://www.anthropic.com/news/developing-computer-use Computer use API documentation: https://docs.anthropic.com/en/docs/build-with-claude/compute... Computer Use Demo: https://github.com/anthropics/anthropic-quickstarts/tree/mai...

Thanks for these. Wonder how many people will use this at work to pretend that they are doing work while they listen to a podcast.

This is cover for the people whose screens are recorded. Run this on the monitorred laptop to make you look busy then do the actual work on laptop 2, some of which might actually require thinking so no mouse movements.
Post reply on HN