Live data from Hacker News

Anthropic downgraded cache TTL on March 6th

github.com

371–380 of 447 posts

Re: Anthropic downgraded cache TTL on March 6th

#371

Earlier quoted context omitted.

>That prices would rise Competition will prevent that from happening. When anyone can host open models and there is giant demand for LLMs companies can not easily raise token prices without sending a lot of traffic to their competitors.

> When anyone can host open models They'd still need to pay the actual power costs.

I didn't say that inference would be free, but that everything to do inference is a commodity which means that competition is easy to do.

Re: Anthropic downgraded cache TTL on March 6th

#373

Has anybody else noticed a pretty significant shift in sentiment when discussing Claude/Codex with other engineers since even just a few months ago? Specifically because of the secret/hidden nature of these changes. I keep getting the sense that people feel like they have no idea if they are getting the product that they originally paid for, or something much weaker, and this sentiment seems to be constantly spreadin…

Just anecdotal, but I was using Claude Code for everything a few months ago, and it seemed great. Now, it is making a ton of mistakes, doing the wrong thing, misunderstanding context, and just generally being unusable. I now have been using Codex and everything has been great (I still swap back and forth but generally to check things out.) My theory is just that the models are great after release to get people switch…

Yeah, shorter time frame but I've been noticing that too. Just the other day I was experimenting with some workflow stuff. "Do x and y and run tests and then merge into develop."

Duly runs, and finishes. "All merged into develop".

I do some other work, don't see any of this, double check myself, I'm working off of develop.

"Hey, where is this work?"

"It is in this branch and this worktree, as you would expect, you will need to merge into develop."

"I'm confused, I asked you to do that and you said it was done."

"You're right and I did say that but I didn't do it. Shall I do it now?"

There's like this really weird balancing act between managing usage, but making people burn more tokens...

Re: Anthropic downgraded cache TTL on March 6th

#374
Given how the cache eviction policy is mismatched with the 5h usage window, it might make sense to just stop at say 97% of the session max usage and keep running a script every 4 min and 50 sec that consumes a minimal number of tokens whose entire purpose is to keep the cache. reply

Re: Anthropic downgraded cache TTL on March 6th

#375

Earlier quoted context omitted.

LLMs can really only mostly do trivial things still, they're always going to do very bad work outside of what your average web developer does day-to-day, and even those things aren't a slam dunk in many cases.

I don't know about "only doing trivial things". I've built a fully threaded webmail replacement for Gmail using imap, indexes mail to postgres, local Django webapp renders everything in a Gmail/Outlook style threaded view with text/html bodies and attachments and a better local search than gmail, and runs all locally. Started as a "could I?" and ended up exceeding all my expectations

That would be considered a trivial thing, why wouldn't it be? It's just basic crud you're doing. Nothing unique and that hasn't been written about tens of thousands of times across millions of books/blogs/comments before.

Re: Anthropic downgraded cache TTL on March 6th

#376

Earlier quoted context omitted.

I wish they would just rip the bandaid to stop everybody's entitled whining. "We're sorry, what we were able to give you for $100/mo before now needs to be $200/mo (or more). We miscalculated/we were too generous/gave too much away for too little. It's a new technology, we are seeing a ton of demand, we are trying to run a business, hope you understand. If you don't want it, don't pay for it."

I would understand the move, but boy would it play right into the "AI is only here to make the rich even richer" feeling wouldn't it?

If I strain really hard, I can come up with a reason why it might play into such a narrative.

/s

Re: Anthropic downgraded cache TTL on March 6th

#377

Earlier quoted context omitted.

Those are the same thing

They are not if there aren't customers who are willing to pay more. For instance imagine a widget that lasts 1 year and is just under 1/2 the price of one that lasts 2 years. There may be high demand because it's the more economical option. If you raise the price so that it's 1/2 the price of the 2 year widget then demand collapses without effecting supply.

If customers were willing to pay more then a higher price wouldn't solve anything. The price is said to be too low exactly because people are trying to buy more than there is available to sell. The whole point of higher prices is to try and scare people away. Not enough supply and a price too low are the same thing.

Re: Anthropic downgraded cache TTL on March 6th

#378

Earlier quoted context omitted.

Bizarre reading the thread, it feels like their Claude responding to the other posters’ Claudes

That was my immediate impression too! It feels like it's all AI maximalists who seem to have a need to filter their every interaction through an LLM. And the result looks and reads just like Moltbook.

Yeah and the employee who generated an AI response to the AI-generated bug report, is Jared Sumner who is the founder of Bun which was acquired by Anthropic. Pretty sad state of affairs all around.

Re: Anthropic downgraded cache TTL on March 6th

#379
post #178

Earlier quoted context omitted.

In this case, they handled things pretty well. You can still use openclaw etc with your regular Anthropic subscription, it will just count towards your extra credits / usage which you can buy for a 30% discount compared to API pricing. And they gave everyone one month’s value in credits. I don’t think they could have done that much better I’d say.

Wait, this is news to me. I thought 3rd party use of the sub was unequivocally prohibited? If I'm understanding you correctly: they changed that policy, you can now use 3rd party software unofficially with the undocumented Claude Code endpoint, and their servers auto-detect this and charge you extra for it? EDIT: Yeah, something like that? > Starting April 4 at 12pm PT / 8pm BST, you’ll no longer be able to use your…

> If I'm understanding you correctly: they changed that policy, you can now use 3rd party software unofficially with the undocumented Claude Code endpoint, and their servers auto-detect this and charge you extra for it?

That’s correct. It’s more like a convenience technicality: you can use your sub account, but you’re paying extra. So it doesn’t really count towards your subscription in any way.

Subscriptions can buy extra credits against a 30% discount, though, so it’s a decent amount cheaper than actual API, but still prohibitively expensive.

Post reply on HN