Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic downgraded cache TTL on March 6th

github.com

Post reply on HN
Print view View original

391–400 of 447 posts

Re: Anthropic downgraded cache TTL on March 6th

#391

Post by wyre »

killingtime74 wrote: post #337
jazzyjackson wrote: post #326

Earlier quoted context omitted.

can't tell if you're being facetious but yes, there's not enough cash in the world to double energy/silicon fab capacity in a year. Infrastructure takes time, hardware is hard, and you have to be willing to bet that the demand will be there 5 years from now to make an investment today.

Until one has the entire supply of world GPU production, cash can solve it by out bidding others

TSMC would never allow all of their output to only one customer. You have an over simplified view of this.

Re: Anthropic downgraded cache TTL on March 6th

#392

Post by raw_anon_1111 »

coldtea wrote: post #362
raw_anon_1111 wrote: post #298

Earlier quoted context omitted.

Just put everyone on pay per use with the API and rip the band aid off.

Even the pay per use is heavily VC subsidied at current prices.

All indications are that inference for API use is margin positive for Open AI and Anthropic not the subscription.

It will basically cut the hobbyist out and entrench large corporations that can pay the real costs.

If that happened and I was working for myself, I would just buy the beefiest computer I could finance and do everything locally.

Re: Anthropic downgraded cache TTL on March 6th

#393

Post by philpem »

CamperBob2 wrote: post #358
lifty wrote: post #17

Earlier quoted context omitted.

I made this switch months ago, ChatGPT 5.4 being a smarter model, but I’ve had subjective feelings of degradation even on 5.4 lately. There’s a lot of growth in usage right now so not sure what kind of optimizations their doing at both companies

Agreed. Watching the intermediate "Thinking about X ... Now I'll do Y" text on GPT 5.4 lately has been like watching a hypothetical smart drug wear off. All of the major models have been getting worse lately, not just Opus.

Makes me wonder if the output is starting to get back into the training input and we're seeing the first signs of model collapse.

Re: Anthropic downgraded cache TTL on March 6th

#394

Post by CamperBob2 »

philpem wrote: post #393
CamperBob2 wrote: post #358

Earlier quoted context omitted.

Agreed. Watching the intermediate "Thinking about X ... Now I'll do Y" text on GPT 5.4 lately has been like watching a hypothetical smart drug wear off. All of the major models have been getting worse lately, not just Opus.

Makes me wonder if the output is starting to get back into the training input and we're seeing the first signs of model collapse.

Business model collapse, maybe.

Can't wait, I need to buy some RAM for my local model server.

Re: Anthropic downgraded cache TTL on March 6th

#395

Post by vbezhenar »

throw_m239339 wrote: post #350
foofloobar wrote: post #304

Claude Code and the subscription are now less useful than a few months ago. Claude Code and the service seem to pick up more and more issues as time goes by: more bugs, fast quota drain, reduced quota, poor model performance, cache invalidation problems, MCP related bugs, potential model quantization and other problems. Claude Code was able to implement something in one shot. It was decent for a proof of concept init…

Every single one of these AI services are running at loss, they are subsidized. Anybody who is surprised that these services are going to get degraded and their cost go up substantially learned nothing from the last 20 years of SAAS. It never gets cheaper.

Use cloud AI hoster with open model. Can't get more transparent and reliable than that. They won't subsidize anything, because the whole point of their business is to rent hardware. Open models won't go anywhere, they're there to stay.

The quality will be a bit behind frontier proprietary models. You gotta pay for what you use, no way to cover your expenses from peers underusing their subscription. But otherwise it should be a reasonable middle ground, with very little risk of rug being pulled out from you.

Re: Anthropic downgraded cache TTL on March 6th

#396

Post by syabro »

visarga wrote: post #235
fluidcruft wrote: post #161

Earlier quoted context omitted.

claude -p not working would be instant unsubscribe downgrade from Max to Pro and further drive my use of codex. I use both but overall have noticed I reach for Claude less than codex lately because claude keeps getting slower and slower (I have not noticed a drop off in quality, but I use it less and less so maybe I'm not in a good position to notice). Generally I find codex and claude make a good team. I'm not a hea…

I might consider switching to codex from claude pro 20x but I need the post tool use, pre file write and post user message hooks. Waiting on codex to deliver. - pre file write -> block editing code files without a task and plan of work - post tool use -> show next open checkbox in the task to the agent, like an instruction pointer - post user message -> log all user messages for periodic review of intent alignment Th…

Try pi

Re: Anthropic downgraded cache TTL on March 6th

#398

Post by Dylan16807 »

infecto wrote: post #381
Dylan16807 wrote: post #365

Earlier quoted context omitted.

A normal person pays $0-10 for an AI plan, maybe double that for a business. $200 is premium.

It is not a premium service, it simply is buying you more tokens. Those $200 gives you at least $400 in API cost tokens. Don't confused price with "premium service". It was not that long ago that folks would be spending $100-200 on their cable service bundle. You are buying a subsidized product when using the plan and the more you spend the more tokens you get, has nothing to do with being a premium service.

> It is not a premium service, it simply is buying you more tokens.

The cheap plans are usually semi-unlimited the same way but not as powerful. This isn't simply a matter of buying more tokens.

> It was not that long ago that folks would be spending $100-200 on their cable service bundle.

Compared to OTA that's premium, but more relevantly if most cable buyers are getting a hypothetical $10 bundle then the $100 one is a premium bundle.

Re: Anthropic downgraded cache TTL on March 6th

#399

Post by [deleted] »

matheusmoreira wrote: post #45
sunaurus wrote: post #16

Has anybody else noticed a pretty significant shift in sentiment when discussing Claude/Codex with other engineers since even just a few months ago? Specifically because of the secret/hidden nature of these changes. I keep getting the sense that people feel like they have no idea if they are getting the product that they originally paid for, or something much weaker, and this sentiment seems to be constantly spreadin…

I certainly noticed a significant drop in reasoning power at some point after I subscribed to Claude. Since then I've applied all sorts of fixes that range from disabling adaptive thinking to maxing out thinking tokens to patching system prompts with an ad-hoc shell script from a gist. Even after all this, Opus will still sometimes go round and round in illogical circles, self-correcting constantly with the telltale…

[deleted]

Re: Anthropic downgraded cache TTL on March 6th

#400

Post by jrpear »

travoc wrote: post #305
jrpear wrote: post #243

Earlier quoted context omitted.

Even if you take it as true that prices have risen recently, and may continue to rise as the VC subsidies dry up, they will fall again long-term. Inference will get more power efficient with model-on-chip solutions like Taalas and God willing we will get cheaper and cheaper renewable energy. Despite this I don't think engineers should feel threatened. As long as there is a need for a human in the loop, as today, ther…

Increased demand will not drive down energy costs.

Of course not necessarily, but I keep seeing articles about how wind and especially solar power just keep getting cheaper.
Post reply on HN