Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude 3.5 Sonnet

anthropic.com

Post reply on HN
Print view View original

71–80 of 287 posts

Re: Claude 3.5 Sonnet

#71

Post by Sharlin »

SXX wrote: post #38
Sharlin wrote: post #36

A while ago I tested the image recognition skills of GPT-4o, Claude 3, and Gemini using a random street plan diagram I happened to have in my downloads folder ( https://i.imgur.com/9WZpK0L.png ). It's a top-down CAD rendering showing the planned renovation of a street in my neighborhood in Tampere, Finland. I uploaded the image and simply asked each model "What can you tell me about the attached picture?" GPT-4o's an…

We can't access any of your chats. You need to post conversations elsewhere.

Thanks, posted them as gists and edited!

Re: Claude 3.5 Sonnet

#72

Post by Sharlin »

skybrian wrote: post #44
nsingh2 wrote: post #37

Earlier quoted context omitted.

BTW I can't access the linked chats, not sure if it's just me.

It looks like claude.ai doesn't have link sharing. There are third-party workarounds, like we used to use for ChatGPT.

GPT has sharing but it doesn't work with chats with images. But I posted the answers as gists and edited my comment.

Re: Claude 3.5 Sonnet

#73

Post by heymijo »

Anyone want to make a case for Anthropic being undervalued?

$7.5 billion raised at an $18.4 billion valuation for Anthropic.

$11.3 billion raised at an $80.0 billion valuation for OpenAI.

Re: Claude 3.5 Sonnet

#74

Post by freediver »

On a first glance, CS3.5 appears to be slightly faster than gpt-4o (62 vs 49 tok/sec) and slightlhy less capable (78% vs 89% accuracy on our internal reasoning benchmark). When initially launched, gpt-4o had speed of over 100 tok/sec, surprised that speed went down as fast.

Re: Claude 3.5 Sonnet

#75

Post by throwup238 »

rubymamis wrote: post #56
throwup238 wrote: post #12

Woah, this is a marked improvement. I just threw a relative complex coding problem at it and 3.5 sonnet did a really good job across several language. I asked it to rewrite a Qt6 QSyntaxHighlighter subclass to use TreeSitter to support arbitrary languages and not only did it work (with a hardcoded language) but it even got the cxx-qt Rust bindings almost right, including the extra header. Curious to see how well it h…

A fellow Qt/QML developer here (get-plume.come). Sounds interesting, what are you building?

An AI chat interface ironically. All of the chat apps are slow as heck electron so I figured there's a market for an actually usable desktop app, especially one that can inline code files and create a RAG index of local documents.

Plume looks great! I'm curious how you implemented the markdown formatted text editing component - I need to implement something similar for the chat input.

Re: Claude 3.5 Sonnet

#76

Post by icelancer »

impulser_ wrote: post #18

Anthropic is the new king. This isn't even Claude 3.5 Opus and it's already super impressive. The speed is insane. I asked it "Write an in depth tutorial on async programming in Go" and it filled out 8 sections of a tutorial with multiple examples per section before GPT4o got to the second section and GPT4o couldn't even finish the tutorial before quitting. I been a fan of Anthropic models since Claude 3. Despite the…

Our internal blinded human evals for summarization/creative work have always preferred Claude 3.0 Opus by a huge margin, so we've been using it for months - GPT-4o didn't unseat it either.

GPT-4o IMO was better for coding (still using GPT-4 original w/ Cursor, but long-form stuff GPT-4o seemed better) but with this new launch, will definitely have to retest.

Pretty big news.

Re: Claude 3.5 Sonnet

#77

Post by freediver »

heymijo wrote: post #73

Anyone want to make a case for Anthropic being undervalued? $7.5 billion raised at an $18.4 billion valuation for Anthropic. $11.3 billion raised at an $80.0 billion valuation for OpenAI.

Look also at revenue - $850m vs $3.5b (from what I could find with a quick search). The numbers change fast, and probably does the valuation.

Re: Claude 3.5 Sonnet

#78

Post by icelancer »

eigenvalue wrote: post #14
prasoonds wrote: post #8

This is amazing - I far prefer the personality of Claude to GPT-4 series models. Also, with coding tasks, Claude-3-Opus and been far better for me vs gpt-4-turbo and gpt-4o both. Looking forward to giving it a spin. Seems like it's doing better than GPT-4o in most benchmarks though I'd like to see if its speed is comparable or not. Also, eagerly awaiting the LMSYS blind comparison results!

I find that it varies between language and task whether GPT-4o or Claude3 Opus will be better. I usually try both now.

I agree. There are some corner cases that GPT-4o reliably fails that Claude does well in, and vice versa. GPT-4 and GPT-4o consistently generates very poor cv2 Python code for human face/boundary box work - it's a strange reproducible failure in my experience.

Re: Claude 3.5 Sonnet

#79

Post by netsec_burn »

Opus remained better than GPT for me, even after the release of GPT-4o. VERY happy to see an even further improvement beyond that, Claude is a terrific product and given the news that GPT-5 only began its training several weeks ago I don't see any situation where Anthropic is dethroned in the near term. There are only two parts of Anthropic's offering I'm not a fan of:

- Lack of conversation sharing: I had a conversation with Claude where I asked it to reverse engineer some assembly code and it did it perfectly on the first try. I was stunned, GPT had failed for days. I wanted to share the conversation with others but there's no way provided like GPT, and no way to even print the conversation because it cuts off on the browser (tested on Firefox).

- No Android app. They're working on this but for now, there's only an iOS app. No expected ETA shared, I've been on the waitlist.

I feel like both of these are relatively basic feature requests for a company of Anthropic's size, yet it has been months with no solution in sight. I love the models, please give me a better way of accessing them.

Re: Claude 3.5 Sonnet

#80

Post by freediver »

For Anthropic devs out there: Please consider adopting a naming convention that will automatically upgrade API users to the latest version when available. Eg. there should be just 'claude-sonnet'.
Post reply on HN