Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Is it just me, or has Claude Opus gotten worse recently?

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 26 posts

Re: Is it just me, or has Claude Opus gotten worse recently?

#11

Post by ramon156 »

the usage and quality out of gpt 5.6 is on par, if not better in token usage. I would love to do a write-up on which tools are useful for what use-case, as AA keeps improving.

I use gemini for rewriting code docs, because the frontier models are so verbose when it comes to writing text

Re: Is it just me, or has Claude Opus gotten worse recently?

#12

Post by spottedmarley »

I know Opus is finished with the simple task I asked for when it starts outputting a 400-page lesson in verbosity (an opus?) complete with comparison tables, bullet-pointed lists of vaguely worded assertions, several self-blunder reports and a list of things it wants to mention but didn't touch yet but just say the word and it will.

Re: Is it just me, or has Claude Opus gotten worse recently?

#13

Post by goonersallofyou »

LLMs are nondeterministic, good luck trying to measure performance at all, much less over time.

Lets say it has gotten worse? What are you going to do about it? Jump to Codex? Then what happen if you perceive that to be getting worse? Jump back to Claude? One of the many problems with these tools.

Re: Is it just me, or has Claude Opus gotten worse recently?

#15

Post by kbrannigan »

spottedmarley wrote: post #12

I know Opus is finished with the simple task I asked for when it starts outputting a 400-page lesson in verbosity (an opus?) complete with comparison tables, bullet-pointed lists of vaguely worded assertions, several self-blunder reports and a list of things it wants to mention but didn't touch yet but just say the word and it will.

When it's overly verbose like that. Does that count against your usage as well? Also during its thinking does it output hidden thinking tokens?

I am now wondering

Re: Is it just me, or has Claude Opus gotten worse recently?

#16

Post by trumbitta2 »

I mean, only yesterday Fable at max effort forgot to commit and push half the changes in two files and didn't mention it until I found out with git status.

It made half the changes, committed and pushed, then it made the other half of the changes on the same two files as before and... just stopped and reported back with a cheerful "all good, all done and pushed".

Re: Is it just me, or has Claude Opus gotten worse recently?

#17

Post by yulaow »

I noticed a few weeks ago it started being very bad at explaining things (even things itself was doing) and started committing absurd errors (like reading a test of 5 lines and not noticing there was an explicit mock created in one of those, then saying that the test was failing while it was not)

I fear this is just the classic "nerf the model just before we release a new version of it"

Re: Is it just me, or has Claude Opus gotten worse recently?

#18

Post by spottedmarley »

kbrannigan wrote: post #15
spottedmarley wrote: post #12

I know Opus is finished with the simple task I asked for when it starts outputting a 400-page lesson in verbosity (an opus?) complete with comparison tables, bullet-pointed lists of vaguely worded assertions, several self-blunder reports and a list of things it wants to mention but didn't touch yet but just say the word and it will.

When it's overly verbose like that. Does that count against your usage as well? Also during its thinking does it output hidden thinking tokens? I am now wondering

It definitely has to count as output tokens when it blathers on endlessly like that, yes. I actually wrote a skill called /speak-normal and that helps but over a long context Opus will forget and start getting real wordy again over time. It can be frustrating.
Post reply on HN