Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

anthropic.com

Post reply on HN
Print view View original

631–640 of 758 posts

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#631

Post by danw1979 »

hobofan wrote: post #35
diggan wrote: post #9

I still feel like the difference between Sonnet and Opus is a bit unclear. Somewhere on Anthropic's website it says that Opus is the most advanced, but on other parts it says Sonnet is the most advanced and also the fastest. The UI doesn't make the distinction clear either. Then on Perplexity, Perplexity says that Opus is the most advanced, compared to Sonnet. And finally, in the table in the blogpost, Opus isn't eve…

Opus hasn't yet gotten an update from 3 to 3.5, and if you line up the benchmarks, the Sonnet "3.5 New" model seems to beat it everywhere. I think they originally announced that Opus would get a 3.5 update, but with every product update they are doing I'm doubting it more and more. It seems like their strategy is to beat the competition on a smaller model that they can train/tune more nimbly and pair it with outside-…

That begs the question: why am I still paying for access to Opus 3 ?

Honestly I don’t know. I’ve not been using Sonnet 3.5 up to now and I’m a fairly light user so I doubt I’ll run into the free tier limits. I’ll probably cancel my subscription until Opus 3.5 comes out (if it ever does).

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#632

Post by DrScientist »

LASR wrote: post #344

This is actually a huge deal. As someone building AI SaaS products, I used to have the position that directly integrating with APIs is going to get us most of the way there in terms of complete AI automation. I wanted to take at stab at this problem and started researching some daily busineses and how they use software. My brother-in-law (who is a doctor) showed me the bespoke software they use in his practice. Runni…

Really good software has automation built in, in the form of macros/scripting.

One of the reasons my bash terminal is more effective than point and click is the easy of automation of routine tasks: from history and aliases to scripting.

Software interop is trickier as it doesn't so much depend on being able to send messages from one piece of software to another, it's you need an agreed format of those messages ( whether they be expressed in the payload of an API, or a UI specific stream of point and clicks ).

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#633

Post by throwaway2037 »

visarga wrote: post #565
CSMastermind wrote: post #415

Earlier quoted context omitted.

RPA has been a huge pain to work with. It's almost always a framework around existing tools like Selenium that you constantly have to fight against to get good results from. I was always left with the feeling that I could build something better myself just handrolling the scripts rather than using their frameworks. Getting Claude integrated into the space is going to be a game changer.

Most RPA work is in dealing with errors and exceptions, not the "happy path". I don't see how Claude's Screen Agent is going to work out there - what do you do when an error pops up and you need to implement specific business logic how to respond? How about consistency over many executions, and enterprise accounts. You want a centralized way to control agent behavior. Scripting based RPA is also much faster and cheap…

I agree with your post.

    > Most RPA work is in dealing with errors and exceptions, not the "happy path".
Isn't this most programming? I always chuckle when a junior hire looks at my code and says: "It is mostly error checking."

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#634

Post by throwaway2037 »

mrbombastic wrote: post #630
SoftTalker wrote: post #534

Earlier quoted context omitted.

But does it do any better at soliciting the surprise requirements from the user, who after confirming that everything works, two months later reports a production bug because the software isn't correctly performing the different reqirements on the first Tuesday of each quarter that you never knew about.

I once had an executive ask to start an incident because he was showing a client the app and a feature that he wanted that had never been spec’d didn’t exist.

So basically, Tog's Paradox in action?

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#635

Post by throwaway2037 »

claytongulick wrote: post #458
tkellogg wrote: post #410

Earlier quoted context omitted.

Honestly, this is going to be huge for healthcare. There's an incredible amount of waste due to incumbent tech making interoperability difficult.

It is. CTO of healthcare org here. I just put a hold on a new RPA project to keep an eye on this and see how it develops. According to their docs, Anthropic will sign a BAA.

What is a BAA?

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#636

Post by bambax »

miyuru wrote: post #582
bambax wrote: post #418

Earlier quoted context omitted.

Companies are going to install an AI inside their own proprietary systems full of proprietary and confidential data and PII about their customers and prospects and whatnot, and let it run around and click on random buttons and submit random forms? Really??!? What could possibly go wrong. I'm currently trying to do a large ORC project using Google Vision API, and then Gemini 1.5 Pro 002 to parse and reconstruct the re…

Have you tried any others? From what I have tried Gemini makes the most mistakes out of all.

I have tried many others for many other things (via OpenRouter) but I have never compared LLMs on the exact same task; it's confusing enough with one engine... ;-)

Sonnet 3.5 for coding is fine but makes "basic" mistakes all the time. Using LLMs is at times like dealing with a senior expert suffering from dementia: it has arcane knowledge of a lot of things but suddenly misses the obvious that would not escape an intern. It's weird, really.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#637

Post by ddalex »

bambax wrote: post #418
pants2 wrote: post #357

Earlier quoted context omitted.

Basically, if it means companies can introduce automation without changing anything about the tooling/workflow/programs they already use, it's going to be MASSIVE. Just and install and a prompt and you've already automated a lengthy manual process - awesome.

Companies are going to install an AI inside their own proprietary systems full of proprietary and confidential data and PII about their customers and prospects and whatnot, and let it run around and click on random buttons and submit random forms? Really??!? What could possibly go wrong. I'm currently trying to do a large ORC project using Google Vision API, and then Gemini 1.5 Pro 002 to parse and reconstruct the re…

LLMs can't reason, or can't reason logically to be precise; what they are really good at is recalling.

So if you want accurate results on writing code you need to put all the docs into the input and THEN ask for your question. So download all docs on Vision, put them in the Gemini prompt and ask your question or code on how to use Vision, and you'll get much closer to truth

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#639

Post by amelius »

LASR wrote: post #344

This is actually a huge deal. As someone building AI SaaS products, I used to have the position that directly integrating with APIs is going to get us most of the way there in terms of complete AI automation. I wanted to take at stab at this problem and started researching some daily busineses and how they use software. My brother-in-law (who is a doctor) showed me the bespoke software they use in his practice. Runni…

I think it was pretty clear from the beginning that the whole AI thing is going to be winner-takes-all.

If you're in some niche doing AI development work, you are going to be outcompeted by more generalized AI at some point.

Post reply on HN