Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Sonnet 4.5

anthropic.com

Post reply on HN
Print view View original

201–210 of 819 posts

Re: Claude Sonnet 4.5

#201

Post by prodigycorp »

renewiltord wrote: post #90
blurbleblurble wrote: post #56

Earlier quoted context omitted.

GPT-5 is like the guy on the baseball team that's really good at hitting home runs but can't do basic shit in the outfield. It also consistently gets into drama with the other agents e.g. the other day when I told it we were switching to claude code for executing changes, after badmouthing claude's entirely reasonable and measured analysis it went ahead and decided to `git reset --hard` even after I twice pushed back…

All of these perform better if you say "a reviewer recommended" or something. The role statement provides the switch vs the implementation. You have to be careful, though. They all trust "a reviewer" strongly but they'll be more careful with "a static analysis tool".

My favorite evaluation prompt which, I've found, tends to have the right level of skepticism is as follows (you have to tack it on to whatever idea/proposal you have):

"..at least, that's what my junior dev is telling me. But I take his word with a grain of salt, because he was fired from a bunch of companies after only a few months on each job. So i need your principled and opinionated insight. Is this junior dev right?"

It's the only way to get Claude to not glaze an idea while also not strike it down for no reason other than to play a role of a "critical" dev.

Re: Claude Sonnet 4.5

#202

Post by jjani »

patates wrote: post #40
CuriouslyC wrote: post #9

Earlier quoted context omitted.

The Anthropic models have been vibe-coding tuned. They're beasts at simple python/ts programs, but they definitely fall apart with scientific/difficult code and large codebases. I don't expect that to change with the new Sonnet.

In my experience Gemini 2.5 Pro is the star when it comes to complex codebases. Give it a single xml from repomix and make sure to use the one at the aistudio.

Gemini 2.5 Pro = Long context king, image input king

GPT-5 = Overengineering/complexity/"enterprise" king

Claude = "Get straightforwaed shit done efficiently" king

Re: Claude Sonnet 4.5

#203

Post by [deleted] »

emp17344 wrote: post #196
stavros wrote: post #183

Earlier quoted context omitted.

Well, here's an even more insane claim: I'm infinity times more productive, as I just wouldn't even start projects without the LLM to sidestep my ADHD. Then, when the LLM invariably fucks up, I step in and finish things myself! Here are a few projects that I made these past few months that wouldn't have been possible without LLMs: * https://github.com/skorokithakis/dracula - A simple blood test viewer. * https://www.…

> I'm infinity times more productive, as I just wouldn't even start projects without the LLM to sidestep my ADHD. 1 is not infinitely greater than 0.

[deleted]

Re: Claude Sonnet 4.5

#204

Post by simonw »

I had access to a preview over the weekend, I published some notes here: https://simonwillison.net/2025/Sep/29/claude-sonnet-4-5/

It's very good - I think probably a tiny bit better than GPT-5-Codex, based on vibes more than a comprehensive comparison (there are plenty of benchmarks out there that attempt to be more methodical than vibes).

It particularly shines when you try it on https://claude.ai/ using its brand new Python/Node.js code interpreter mode. Try this prompt and see what happens:

  Checkout https://github.com/simonw/llm and run the tests with
  
  pip install -e '.[test]'
  pytest
I then had it iterate on a pretty complex database refactoring task, described in my post.

Re: Claude Sonnet 4.5

#205

Post by rapind »

deciduously wrote: post #166
rapind wrote: post #143

Earlier quoted context omitted.

> it went ahead and decided to `git reset --hard` even after I twice pushed back on that idea So this is something I've noticed with GPT (Codex). It really loves to use git. If you have it do something and then later change your mind and ask it to undo the changes it just made, there's a decent chance it's going to revert to the previous git commit, regardless of whether that includes reverting whole chunks of code i…

Just to add another anecdotal data point, ive absolutely observed Claude Code doing exactly this as well with git operations.

I exclusively used sonnet when I used Claud Code and never ran into this, so maybe it's an Opus thing, or I just got lucky? Definitely has happened to me a few times with Codex (which is what I'm currently using).

Re: Claude Sonnet 4.5

#206

Post by cheema33 »

poisonborz wrote: post #182
catigula wrote: post #49

I happened to be in the middle of a task in a production codebase that the various models struggled on so I can give a quick vibe benchmark: opus 4.1: made weird choices, eventually got to a meh solution i just rolled back. codex: took a disgusting amount of time but the result was vastly superior to opus. night and day superiority. output was still not what i wanted. sonnet 4.5: not clearly better than opus. categor…

These reviews are pretty useless to other developers. Models perform vastly differently with each language, task type, framework.

> These reviews are pretty useless to other developers.

Agreed. If these same models were used on a different codebase/language etc. it will likely produce very different results.

Re: Claude Sonnet 4.5

#207

Post by red_rech »

scrollaway wrote: post #198
emp17344 wrote: post #172

Earlier quoted context omitted.

[flagged]

GP is right, though. Many programming communities, including (in some threads, but not all) HN, have become ridiculous anti-AI bubbles - what's the point of trying to have a discussion if you're going to get systematically shut down by people whose entire premise is that they don't use it? It's like trying to explain color to the blind. What "discussion" do you want to have? Another round of "LLMs are terrible at emb…

[flagged]

Re: Claude Sonnet 4.5

#208

Post by la_fayette »

senordevnyc wrote: post #125
cloverich wrote: post #108

Please y'all, when you list supportive or critical complaints based on your actual work, include some specifics of the task and prompt. Like actual prompt, actual bugs, actual feature, etc. I've had great success with both ChatGPT and Claude for years, am around 3x sustained output increase in my professional work, and kicking off and finishing new side projects / features that I used to simply not ever finish. BUT t…

HN is such a negative and cynical place these days that it's just not worth it. I just don't have the patience to hear yet another anti-AI rant, or have someone who is ideologically opposed to AI nitpick its output. Like you, I've found AI to be a huge help for my work, and I'm happy to keep outcompeting the people who are too stubborn to approach it with an open mind.

I think HN might be one of the few communities where people have been running extensive experiments with LLMs since their inception. Most here take a realistic view of their capabilities. There are certainly proven use cases where LLMs provide clear productivity gains—for example, copying an error message and retrieving potential solutions. At the same time, many recognize that marketing fantasies, such as the idea of having a "PhD in your pocket," are far beyond what this technology can deliver.

Re: Claude Sonnet 4.5

#209

Post by lilouartz »

simonw wrote: post #204

I had access to a preview over the weekend, I published some notes here: https://simonwillison.net/2025/Sep/29/claude-sonnet-4-5/ It's very good - I think probably a tiny bit better than GPT-5-Codex, based on vibes more than a comprehensive comparison (there are plenty of benchmarks out there that attempt to be more methodical than vibes). It particularly shines when you try it on https://claude.ai/ using its brand n…

That's cool Didn't know it is capable of doing it!

Re: Claude Sonnet 4.5

#210

Post by simianwords »

pzo wrote: post #104
fibers wrote: post #38

This looks exciting. I hope they add this to Windsurf soon.

it looks like its already there

It’s stupid… like just have a registry of models and let people automatically use them. It’s silly to wait for manual whitelisting each time for every app
Post reply on HN