Claude 3.7 Sonnet Thinking scores 33.5 (4th place after o1, o3-mini, and DeepSeek R1) on my Extended NYT Connections benchmark. Claude 3.7 Sonnet scores 18.9. I'll run my other benchmarks in the upcoming days.
Claude 3.7 Sonnet and Claude Code
581–590 of 1001 posts
Re: Claude 3.7 Sonnet and Claude Code
#582You can get your HN profile analyzed by it and it's pretty funny :) https://hn-wrapped.kadoa.com/ I'm using this to test the humor of new models.
> You'll write a comment about chickens that somehow transitions into a critique of modern UI design principles, garnering your highest karma score yet.
Challenge accepted.
Re: Claude 3.7 Sonnet and Claude Code
#583You can get your HN profile analyzed by it and it's pretty funny :) https://hn-wrapped.kadoa.com/ I'm using this to test the humor of new models.
This is fucking golden. It's incredible how accurate and funny it is
Re: Claude 3.7 Sonnet and Claude Code
#584You can get your HN profile analyzed by it and it's pretty funny :) https://hn-wrapped.kadoa.com/ I'm using this to test the humor of new models.
> Hacker News: You'll write a comment so perfectly balanced between technical insight and dry humor that it breaks the upvote system, forcing dang to implement a new 'slow clap' feature just for you.
fist pump
Re: Claude 3.7 Sonnet and Claude Code
#585You can get your HN profile analyzed by it and it's pretty funny :) https://hn-wrapped.kadoa.com/ I'm using this to test the humor of new models.
This should be a show hm post. 10/10 humor
Re: Claude 3.7 Sonnet and Claude Code
#586Hi everyone! Boris from the Claude Code team here. @eschluntz, @catherinewu, @wolffiex, @bdr and I will be around for the next hour or so and we'll do our best to answer your questions about the product.
I really want to try your AI models, but "You must have a valid phone number to use Anthropic's services." is a show-stopper for me. It's the only mainstream AI service that requests this information. After a string of security lapses by many of your competitors, I have zero faith in the ability of a "fast moving" AI-focused company to keep my PII data secure.
It's a phone number. It's probably been bought / sold a few times already.
Unless you're on the level of Edward Snowden, I wouldn't worry about it. But maybe your sense of privacy is more valuable than the outcome you'd get from Claude. That's fine too.
Re: Claude 3.7 Sonnet and Claude Code
#587Earlier quoted context omitted.
This test has always been so stupid since models work at the token level. Claude 3.5 already 5xs your frontend dev speed but people still say "hurr durr it can't count strawberry" as if that's a useful problem
This test isn't stupid. If it can't count the number of letters in a text, can you rely on it with more important calculations?
Not on calculations that involve counting at a sub-token level. Otherwise, it depends.
Re: Claude 3.7 Sonnet and Claude Code
#588Tested on some chemistry problem; interestingly it was wrong on a molecular structure. Once I corrected it, it was able to draw it correctly. It was very polite about it.
Re: Claude 3.7 Sonnet and Claude Code
#589Re: Claude 3.7 Sonnet and Claude Code
#590I just sub’d to Claude a few days ago to rank against extensive use of gpt-4o and o1.
So I started using this today not knowing it was even new.
One thing I noticed is when I tried uploading a PowerPoint template produced by Google slides that was 3 slides—-just to give styling and format—-the web client said I’d exceeded line limit by 1200+%.
Is that intentional?
I wanted Claude to update the deck with content I provided in markdown but it could seemingly not be done, as the line overflow error prevented submission.