Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude 4

anthropic.com

Post reply on HN
Print view View original

391–400 of 1001 posts

Re: Claude 4

#391

Post by mrandish »

simonw wrote: post #343

I got Claude 4 Opus to summarize this thread on Hacker News when it had hit 319 comments: https://gist.github.com/simonw/0b9744ae33694a2e03b2169722b06... Token cost: 22,275 input, 1,309 output = 43.23 cents - https://www.llm-prices.com/#it=22275&ot=1309&ic=15&oc=75&sb=... Same prompt run against Sonnet 4: https://gist.github.com/simonw/1113278190aaf8baa2088356824bf... 22,275 input, 1,567 output = 9.033 cents https://…

Interesting, thanks for doing this. Both summaries are serviceable and quite similar but I had a slight preference for Sonnet 4's summary which, at just ~20% of the cost of Claude 4 Opus, makes it quite the value leader.

This just highlights that, with compute requirements for meaningful traction against hard problems spiraling skyward for each additional increment, the top models on current hard problems will continue to cost significantly more. I wonder if we'll see something like an automatic "right-sizing" feature that uses a less expensive model for easier problems. Or maybe knowing whether a problem is hard or easy (with sufficient accuracy) is itself hard.

Re: Claude 4

#392

Post by BeetleB »

Keyframe wrote: post #304
leetharris wrote: post #152

Earlier quoted context omitted.

Much like others, this is my stack (or o1-pro instead of Gemini 2.5 Pro). This is a big reason why I use aider for large projects. It allows me to effortlessly combine architecture models and code writing models. I know in Cursor and others I can just switch models between chats, but it doesn't feel intentional the way aider does. You chat in architecture mode, then execute in code mode.

could you describe a bit how does this work? I haven't had much luck with AI so far, but I'm willing to try.

https://aider.chat/2024/09/26/architect.html

The idea is that some models are better at reasoning about code, but others are better at actually creating the code changes (without syntax errors, etc). So Aider lets you pick two models - one does the architecting, and the other does the code change.

Re: Claude 4

#393

Post by nprateem »

I posted it earlier.

Anthropic: You're killing yourselves by not supporting structured responses. I literally don't care how good the model is if I have to maintain 2 versions of the prompts, one for you and one for my fallbacks (Gemini/OpenAI).

Get on and support proper pydantic schemas/JSON objects instead of XML.

Re: Claude 4

#394

Post by 11101010001100 »

throwaway314155 wrote: post #132
mxwsn wrote: post #37

Earlier quoted context omitted.

Gemini has beat it already, but using a different and notably more helpful harness. The creator has said they think harness design is the most important factor right now, and that the results don't mean much for comparing Claude to Gemini.

Way offtopic to TFA now, but isn't using an improved harness a bit like saying "I'm going to hardcore as many priors as possible into this thing so it succeeds regardless of its ability to strategize, plan and execute?

They asked gemini to come up with another word for cheating and it came up with 'harness'.

Re: Claude 4

#397

Post by dakna »

yosito wrote: post #169
ModernMech wrote: post #66

Earlier quoted context omitted.

That's kind of my benchmark for whether or not these models are useful. I've got a project that needs some extensive refactoring to get working again. Mostly upgrading packages, but also it will require updating the code to some new language semantics that didn't exist when it was written. So far, current AI models can make essentially zero progress on this task. I'll keep trying until they can!

Personally, I don't believe AI is ever going to get to that level. I'd love to be proven wrong, but I really don't believe that an LLM is the right tool for a job that requires novel thinking about out of the ordinary problems like all the weird edge cases and poor documentation that comes up when trying to upgrade old software.

Google demoed an automated version upgrade for Android libraries during I/O 2025. The agent does multiple rounds and checks error messages during each build until all dependencies work together.

Agentic Experiences: Version Upgrade Agent

https://youtu.be/ubyPjBesW-8?si=VX0MhDoQ19Sc3oe-

Re: Claude 4

#398

Post by bbor »

vinhphm wrote: post #93
BaculumMeumEst wrote: post #65

Earlier quoted context omitted.

Anyone see news of when it’s planned to go live in copilot?

The option just shown up in Copilot settings page for me

Turns out Opus 4 starts at their $40/mo ("Pro+") plan which is sad, and they serve o4-mini and Gemini as well so it's a bit less exclusive than this announcement implies. That said, I have a random question for any Anthropic-heads out there:

GitHub says "Claude Opus 4 is hosted by Anthropic PBC. Claude Sonnet 4 is hosted by Anthropic 1P."[1]. What's Anthropic 1P? Based on the only Kagi result being a deployment tutorial[2] and the fact that GitHub negotiated a "zero retention agreement" with the PBC but not whatever "1P" is, I'm assuming it's a spinoff cloud company that only serves Claude...? No mention on the Wikipedia or any business docs I could find, either.

Anyway, off to see if I can access it from inside SublimeText via LSP!

[1] https://docs.github.com/en/copilot/using-github-copilot/ai-m...

[2] https://github.com/anthropics/prompt-eng-interactive-tutoria...

Re: Claude 4

#399

Post by mmaunder »

Probably (and unfortunately) going to need someone from Anthropic to comment on what is becoming a bit of a debacle. Someone who claims to be working on alignment at Anthropic tweeted:

“If it thinks you're doing something egregiously immoral, for example, like faking data in a pharmaceutical trial, it will use command-line tools to contact the press, contact regulators, try to lock you out of the relevant systems, or all of the above.”

The tweet was posted to /r/localllama where it got some traction.

The poster on X deleted the tweet and posted:

“I deleted the earlier tweet on whistleblowing as it was being pulled out of context. TBC: This isn't a new Claude feature and it's not possible in normal usage. It shows up in testing environments where we give it unusually free access to tools and very unusual instructions.”

Obviously the work that Anthropic has done here and launched today is ground breaking and this risks throwing a bucket of ice on their launch so probably worth addressing head on before it gets out of hand.

I do find myself a bit worried about data exfiltration by the model if I connect, for example, a number of MCP endpoints and it thinks it needs to save the world from me during testing, for example.

https://x.com/sleepinyourhat/status/1925626079043104830?s=46

https://www.reddit.com/r/LocalLLaMA/s/qiNtVasT4B

Re: Claude 4

#400

Post by transcranial »

pzo wrote: post #254
__jl__ wrote: post #21

Earlier quoted context omitted.

Thanks. I looked a couple minutes ago and couldn't see it. For anyone curious, pricing remains the same as previous Anthropic models.

surprisingly cursor charges only 0.75x for request for sonnet 4.0 (comparing to 1x for sonnet 3.7)

It does say "temporarily offered at a discount" when you hover over the model in the dropdown.
Post reply on HN