Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

anthropic.com

Post reply on HN
Print view View original

81–90 of 758 posts

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#81

Post by highwaylights »

Completely irrelevant, and it might just be me, but I really like Anthropic's understated branding.

OpenAI's branding isn't exactly screaming in your face either, but for something that's generated as much public fear/scaremongering/outrage as LLMs have over the last couple of years, Anthropic's presentation has a much "cosier" veneer to my eyes.

This isn't the Skynet Terminator wipe-us-all-out AI, it's the adorable grandpa with a bag of werthers wipe-us-all-out AI, and that means it's going to be OK.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#82

Post by swalsh »

minimaxir wrote: post #5

From the computer use video demo, that's a lot of API calls. Even though Claude 3.5 Sonnet is relatively cheap for its performance, I suspect computer use won't be. It's a very good idea that Anthropic upfront that it isn't perfect. And it's guaranteed that there will be a viral story where Claude will accidentally delete something important with it. I'm more interested in Claude 3.5 Haiku, particularly if it is inde…

I suspect these models have been getting smaller on the back-end, and the GPU's have been getting bigger. It's probably not a huge deal.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#83

Post by Guillaume86 »

Hizonner wrote: post #37
minimaxir wrote: post #5

From the computer use video demo, that's a lot of API calls. Even though Claude 3.5 Sonnet is relatively cheap for its performance, I suspect computer use won't be. It's a very good idea that Anthropic upfront that it isn't perfect. And it's guaranteed that there will be a viral story where Claude will accidentally delete something important with it. I'm more interested in Claude 3.5 Haiku, particularly if it is inde…

It's just bizarre to force a computer to go through a GUI to use another computer. Of course it's going to be expensive.

Maybe fixing this for AI will finally force good accessibility support on major platforms/frameworks/apps (we can dream).

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#84

Post by abeppu »

HanClinto wrote: post #13

Why not rev the numbers? "3.5" vs. "3.5 New" feels weird -- is there a particular reason why Anthropic doesn't want to call this 3.6 (or even 3.5.1)?

The confusing choice they seem to have made is that "Claude 3.5 Sonnet" is a name, rather than 3.5 being a version. In their view, the model "version" is now `claude-3-5-sonnet-20241022` (and was previously `claude-3-5-sonnet-20240620`).

https://docs.anthropic.com/en/docs/about-claude/models

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#85

Post by hobofan »

diggan wrote: post #61
hobofan wrote: post #35

Earlier quoted context omitted.

Opus hasn't yet gotten an update from 3 to 3.5, and if you line up the benchmarks, the Sonnet "3.5 New" model seems to beat it everywhere. I think they originally announced that Opus would get a 3.5 update, but with every product update they are doing I'm doubting it more and more. It seems like their strategy is to beat the competition on a smaller model that they can train/tune more nimbly and pair it with outside-…

> Opus hasn't yet gotten an update from 3 to 3.5, and if you line up the benchmarks, the Sonnet "3.5 New" model seems to beat it everywhere Why isn't Anthropic clearer about Sonnet being better then? Why isn't it included in the benchmark if new Sonnet beats Opus? Why are they so ambiguous with their language? For example, https://www.anthropic.com/api says: > Sonnet - Our best combination of performance and speed fo…

> I don't understand why this seems purposefully ambiguous?

I wouldn't attribute this to malice when it can also be explained by incompetence.

Sonnet 3.5 New > Opus 3 > Sonnet 3.5 is generally how they stack up against each other when looking at the total benchmarks.

"Sonnet 3.5 New" has just been announced, and they likely just haven't updated the marketing copy across the whole page yet, and maybe also haven't figured out how to graple with the fact that their new Sonnet model was ready faster than their next Opus model.

At the same time I think they want to keep their options open to either:

A) drop a Opus 3.5 soon that will bring the logic back in order again

B) potentially phase out Opus, and instead introduce new branding for what they called a "reasoning model" like OpenAI did with o1(-preview)

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#86

Post by famouswaffles »

Hizonner wrote: post #63
hobofan wrote: post #59

Earlier quoted context omitted.

With UIPath, Appian, etc. the whole field of RPA (robotic process automation) is a $XX billion industry that is built on that exact premise (that it's more feasible to do automation via GUIs than badly built/non-existing APIs). Depending on how many GUI actions correspond to one equivalent AI orchestrated API call, this might also not be too bad in terms of efficiency.

Most of the GUIs are Web pages, though, so you could just interact directly with an HTTP server and not actually render the screen. Or you could teach it to hack into the backend and add an API... Oh, and on edit, "bizarre" and "multi-billion-dollar-industry" are well known not to be mutually exclusive.

>Most of the GUIs are Web pages, though, so you could just interact directly with an HTTP server and not actually render the screen.

The end goal isn't just web pages (And i wouldn't say most GUIs are web pages). Ideally, you'd also want this to be able to navigate say photoshop or any other application. And the easier your method can switch between platforms and operating systems the better

We've already built computer use around GUIs so it's just much easier to center LLMs around them too. Text is an option for the command line or the web but this isn't an easy option for the vast majority of desktop applications, nevermind mobile.

It's the same reason general purpose robots are being built into a human form factor. The human form isn't particularly special and forcing a machine to it has its own challenges but our world and environment has been built around it and trying to build a hundred different specialized form factors is a lot more daunting.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#87

Post by mmooss »

Of course there's great inefficiency in having the Claude software control a computer with a human GUI mediating everything, but it's necessary for many uses right now given how much we do where only human interfaces are easily accessible. If something like it takes off, I expect interfaces for AI software would be published, standardized, etc. Your customers may not buy software that lacks it.

But what I really want to see is a CLI. Watching their software crank out Bash, vim, Emacs!, etc. - that would be fascinating!

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#89

Post by swalsh »

Hizonner wrote: post #37
minimaxir wrote: post #5

From the computer use video demo, that's a lot of API calls. Even though Claude 3.5 Sonnet is relatively cheap for its performance, I suspect computer use won't be. It's a very good idea that Anthropic upfront that it isn't perfect. And it's guaranteed that there will be a viral story where Claude will accidentally delete something important with it. I'm more interested in Claude 3.5 Haiku, particularly if it is inde…

It's just bizarre to force a computer to go through a GUI to use another computer. Of course it's going to be expensive.

Building an entirely new world for agents to compute in is far more difficult than building an agent that can operate in a human world. However i'm sure over time people will start building bridges to make it easier/cheaper for agents to operate in their own native environment.

It's like another digital transformation. Paper lasted for years before everything was digitalized. Human interfaces will last for years before the conversational transformation is complete.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#90

Post by TiredOfLife »

neb_b wrote: post #67
bhouston wrote: post #23

Is there an easy way to use Claude as a Co-Pilot in VS Code? If it is better at coding, it would be great to have it integrated.

You can use it in Cursor - called "Cursor Tab" IMO Cursor Tab performs much better than Co-Pilot, easily works through things that would cause Co-Pilot to get stuck, you should give it a try

As I understand Cursor tab autocomplete uses their own model. Only chat has Sonnet and co.
Post reply on HN