Claude 3.5 Sonnet

#1

Post by squadrick » Thu, Jun 20, 2024, 2:03 PM UTC

Claude 3.5 Sonnet
anthropic.com

Re: Claude 3.5 Sonnet

#2

Post by [deleted] » Thu, Jun 20, 2024, 2:09 PM UTC

[deleted]

Re: Claude 3.5 Sonnet

#3

Post by swalsh » Thu, Jun 20, 2024, 2:12 PM UTC

Anthropic has been killing it. I subscribe to both chatgpt pro and claude, but I spend probably 90% of my time using Claude. I usually only go back to open ai when I want another model to evaluate or modify the results.

Re: Claude 3.5 Sonnet

#4

Post by meetpateltech » Thu, Jun 20, 2024, 2:20 PM UTC

> Artifacts—a new way to use Claude You can ask Claude to generate docs, code, mermaid diagrams, vector graphics, or even simple games.

this is new and I just tried a simple dice roll into a React component, and it works perfectly.

Re: Claude 3.5 Sonnet

#5

Post by 22c » Thu, Jun 20, 2024, 2:27 PM UTC

swalsh wrote: post #3

Anthropic has been killing it. I subscribe to both chatgpt pro and claude, but I spend probably 90% of my time using Claude. I usually only go back to open ai when I want another model to evaluate or modify the results.

I was worried how they'd do as it felt like Opus was very expensive compared to GPT-4o but with worse performance. They're now claiming to beat GPT-4o AND do it cheaper, that's impressive.

Re: Claude 3.5 Sonnet

#6

Post by vatsadev » Thu, Jun 20, 2024, 2:27 PM UTC

I wonder if they used new mech interp techniques on this

Re: Claude 3.5 Sonnet

#7

Post by pantsforbirds » Thu, Jun 20, 2024, 2:28 PM UTC

This is a very strong offering. I've been really impressed with 3.0 Haiku for smaller tasks, but I'm going to have to test 3.5 Sonnet as our primary pipeline model.

Re: Claude 3.5 Sonnet

#8

Post by prasoonds » Thu, Jun 20, 2024, 2:29 PM UTC

This is amazing - I far prefer the personality of Claude to GPT-4 series models. Also, with coding tasks, Claude-3-Opus and been far better for me vs gpt-4-turbo and gpt-4o both. Looking forward to giving it a spin.

Seems like it's doing better than GPT-4o in most benchmarks though I'd like to see if its speed is comparable or not. Also, eagerly awaiting the LMSYS blind comparison results!

Re: Claude 3.5 Sonnet

#9

Post by anais9 » Thu, Jun 20, 2024, 2:29 PM UTC

This is awesome! Until GPT-4o dropped, Claude 3 Opus was hands down my go-to for code generation.

Between these model performance improvements and their new "artifacts" handling, I get the impression this update may sway me strongly back towards Anthropic (at least for this use case).

Re: Claude 3.5 Sonnet

#10

Post by brokensegue » Thu, Jun 20, 2024, 2:29 PM UTC

Can anyone find pricing details?

Ah it is "The model costs $3 per million input tokens and $15 per million output tokens"