Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

anthropic.com

Post reply on HN
Print view View original

151–160 of 758 posts

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#151

Post by torginus »

accrual wrote: post #132
torginus wrote: post #104

Claude's current ability to use computers is imperfect. Some actions that people perform effortlessly—scrolling, dragging, zooming—currently present challenges for Claude and we encourage developers to begin exploration with low-risk tasks. Nice, but I wonder why didn't they use UI automation/accessibility libraries, that have access to the semantic structure of apps/web pages, as well as accessing documents directly…

I wonder if the model has difficulties for the same reason some people do - UI affordability has gone down with the flattening, hover-to-see scrollbar, hamburger-menu-ization of UIs. I'd like to see a model trained on a Windows 95/NT style UI - would it have an easier time with each UI element having clearly defined edges, clearly defined click and dragability, unified design language, etc.?

What the UI looks like has no effect on for example, Windows UI Automation libraries. How the tech works is that it queries the process directly for the sematic description of items, like here's a button called 'Delete', here's a list of items for TODO's, and you get the tree structure directly from the API.

I wouldn't be surprised if they are working off of screenshots, they still trained their models on having said screenshots annotated by said automation libraries, which told the AI what pixel is what.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#152

Post by machiaweliczny »

cube2222 wrote: post #36

This looks quite fantastic! Nice improvements in scores across the board, e.g. > On coding, it [the new Sonnet 3.5] improves performance on SWE-bench Verified from 33.4% to 49.0%, scoring higher than all publicly available models—including reasoning models like OpenAI o1-preview and specialized systems designed for agentic coding. I've been using Sonnet 3.5 for most of my AI-assisted coding and I'm already very happy…

I'm waiting for Aider benchmark

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#154

Post by pglevy »

riffraff wrote: post #18
nisten wrote: post #15

Earlier quoted context omitted.

For a company selling intelligence, that's a pretty stupid way of labelling a new product.

"computer use" is also as bad a marketing choice as possible for something that actually seems pretty cool.

I had no idea what the headline meant before reading the article. I wasn't even sure how to pronounce "use." (Maybe a typo?) I think something like "Claude adds Keyboard & Mouse Control" would be clearer.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#155

Post by joelanman »

minimaxir wrote: post #95
highwaylights wrote: post #81

Completely irrelevant, and it might just be me, but I really like Anthropic's understated branding. OpenAI's branding isn't exactly screaming in your face either, but for something that's generated as much public fear/scaremongering/outrage as LLMs have over the last couple of years, Anthropic's presentation has a much "cosier" veneer to my eyes. This isn't the Skynet Terminator wipe-us-all-out AI, it's the adorable…

Anthropic has recently begun a new, big ad campaign (ads in Times Square) that more-or-less takes potshots at OpenAI. https://www.reddit.com/r/singularity/comments/1g9e0za/anthro...

'transparent' in what sense?

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#156

Post by Eisenstein »

famouswaffles wrote: post #117
cube2222 wrote: post #65

Earlier quoted context omitted.

There was a recent article[0] trending on HN a about their revenue numbers, split by B2C vs B2B. Based on it, it seems like Anthropic is 60% of OpenAI API-revenue wise, but just 4% B2C-revenue wise. Though I expect this is partly because the Claude web UI makes 3.5 available for free, and there's not that much reason to upgrade if you're not using it frequently. [0]: https://www.tanayj.com/p/openai-and-anthropic-reve…

3.5 is rate limited free, same as 4o (4o's limits are actually more generous). I think the real reason is much simpler - Claude/Anthropic has basically no awareness in the general public compared to Open AI. The chatGPT site had over 3B visits last month (#11 in Worldwide Traffic). Gemini and Character AI get a few hundred million but Claude doesn't even register in comparison. [0] Last they reported, OpenAI said the…

They also had a very limited roll-out at first. Until somewhat recently Canada and Europe were excluded from the list of places they allowed sign-ups from.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#157

Post by thundergolfer »

jatins wrote: post #10

How does the computer use work -- Is this a desktop app they are providing that can do actions on your computer? Didn't see any such mention in the post

It’s a sandbox compute environment, using Gvisor or Firecracker or similar, which exposes a browser environment to the LLM.

modal.com’s modal.Sandbox can be the compute layer for this. It uses Gvisor under the hood.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#159

Post by JamesBarney »

diggan wrote: post #9

I still feel like the difference between Sonnet and Opus is a bit unclear. Somewhere on Anthropic's website it says that Opus is the most advanced, but on other parts it says Sonnet is the most advanced and also the fastest. The UI doesn't make the distinction clear either. Then on Perplexity, Perplexity says that Opus is the most advanced, compared to Sonnet. And finally, in the table in the blogpost, Opus isn't eve…

Sonnet is better for most things. But I do prefer Opus's writing style to Sonnet.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#160

Post by kalkin »

diggan wrote: post #9

I still feel like the difference between Sonnet and Opus is a bit unclear. Somewhere on Anthropic's website it says that Opus is the most advanced, but on other parts it says Sonnet is the most advanced and also the fastest. The UI doesn't make the distinction clear either. Then on Perplexity, Perplexity says that Opus is the most advanced, compared to Sonnet. And finally, in the table in the blogpost, Opus isn't eve…

By reputation -- I can't vouch for this personally, and I don't know if it'll still be true with this update -- Opus is still often better for things like creative writing and conversations about emotional or political topics.
Post reply on HN