301–310 of 1001 posts
Ooh, VS Code integration for Claude Code sounds nice. I do feel like Claude Code works better than the native Cursor agent mode. Edit: How do you install it? Running `/ide` says "Make sure your IDE has the Claude Code extension", where do you get that?
> we’ve significantly reduced behavior where the models use shortcuts or loopholes to complete tasks. Both models are 65% less likely to engage in this behavior than Sonnet 3.7 on agentic tasks Sounds like it’ll be better at writing meaningful tests
Can anyone help me understand why they changed the model naming convention? BEFORE: claude-3-7-sonnet AFTER: claude-sonnet-4
Earlier quoted context omitted.
Gemini is _very_ good at architecture level thinking and implementation. I tend to find that I use Gemini for the first pass, then switch to Claude for the actual line-by-line details. Claude is also far superior at writing specs than Gemini.
Much like others, this is my stack (or o1-pro instead of Gemini 2.5 Pro). This is a big reason why I use aider for large projects. It allows me to effortlessly combine architecture models and code writing models. I know in Cursor and others I can just switch models between chats, but it doesn't feel intentional the way aider does. You chat in architecture mode, then execute in code mode.
Earlier quoted context omitted.
So I decided to try Claude 4 Sonnet against my "Given a list of 1 million random integers between 1 and 100,000, find the difference between the smallest and the largest numbers whose digits sum up to 30." benchmark I tested against Claude 3.5 Sonnet: https://news.ycombinator.com/item?id=42584400 The results are here ( https://gist.github.com/minimaxir/1bad26f0f000562b1418754d67... ) and it utterly crushed the proble…
I did a quick review of its final answer and looks like there are logic errors. All three of them get the incorrect max-value bound (even with comments saying 9+9+9+9+3 = 30), so early termination wouldn't happen in the second and third solution, but that's an optimization detail. The first version would, however, early terminate on the first occurrence of 3999 and take whatever the max value was up to that point. So…
I reran the test to run a dataset of 1 to 500,000 and sum digits up to 37 and it went back to the numba JIT implementation that was encountered in my original blog post, without numerology shenanigans. https://gist.github.com/minimaxir/a6b7467a5b39617a7b611bda26...
I did also run the model at temp=1, which came to the same solution but confused itself with test cases: https://gist.github.com/minimaxir/be998594e090b00acf4f12d552...
Interesting alignment notes from Opus 4: https://x.com/sleepinyourhat/status/1925593359374328272 "Be careful about telling Opus to ‘be bold’ or ‘take initiative’ when you’ve given it access to real-world-facing tools...If it thinks you’re doing something egregiously immoral, for example, like faking data in a pharmaceutical trial, it will use command-line tools to contact the press, contact regulators, try to lock yo…
What’s your guess on when Claude 4 will be available on AWS Bedrock?
Earlier quoted context omitted.
So I decided to try Claude 4 Sonnet against my "Given a list of 1 million random integers between 1 and 100,000, find the difference between the smallest and the largest numbers whose digits sum up to 30." benchmark I tested against Claude 3.5 Sonnet: https://news.ycombinator.com/item?id=42584400 The results are here ( https://gist.github.com/minimaxir/1bad26f0f000562b1418754d67... ) and it utterly crushed the proble…
> although it's possible Claude 4 was trained on that discussion lol This is why we can't have consistent benchmarks
An important note not mentioned in this announcement is that Claude 4's training cutoff date is March 2025, which is the latest of any recent model. (Gemini 2.5 has a cutoff of January 2025) https://docs.anthropic.com/en/docs/about-claude/models/overv...
Although I believe it, I wish there was some observability into what data is included here. Both Sonnet and Opus 4 say Joe Biden is president and claim their knowledge cutoff is "April 2024".
Anyone know if this is usable with Claude Code? If so, how? I've not seen the ability to configure the backend for Claude Code, hmm
What's new:
• Added `DISABLE_INTERLEAVED_THINKING` to give users the option to opt out of interleaved thinking.
• Improved model references to show provider-specific names (Sonnet 3.7 for Bedrock, Sonnet 4 for Console)
• Updated documentation links and OAuth process descriptions
• Claude Code is now generally available
• Introducing Sonnet 4 and Opus 4 models