Live data from Hacker News

Anthropic downgraded cache TTL on March 6th

github.com

351–360 of 447 posts

Re: Anthropic downgraded cache TTL on March 6th

#352

Earlier quoted context omitted.

People keep repeating this without any real thought behind it because of the high profile resignations on the Qwen team. Meanwhile the Minimax team just released a new open weights version of their 229B model yesterday. So much for that narrative. The AI landscape in China is larger than just Qwen and Alibaba.

> Meanwhile the Minimax team just released a new open weights version of their 229B model yesterday. its under new license prohibiting any commercial use.

Who in the world would care about that, and why?

You know what else was under a license prohibiting commercial use? The training data.

Re: Anthropic downgraded cache TTL on March 6th

#353

Earlier quoted context omitted.

People keep repeating this without any real thought behind it because of the high profile resignations on the Qwen team. Meanwhile the Minimax team just released a new open weights version of their 229B model yesterday. So much for that narrative. The AI landscape in China is larger than just Qwen and Alibaba.

Of course, but for how long? Do you think that companies will keep giving away valuable assets for free forever, or do you think that in the near future there's going to be an open weights model that's so good that people keep using it indefinitely instead of going back to frontier model providers? The first one is just incredibly naive, the second might be true for some people, for some tasks, but it's not going to…

do you think that in the near future there's going to be an open weights model that's so good that people keep using it indefinitely instead of going back to frontier model providers?

We are almost at that point now, where the harnesses and tools are more important drivers of functionality and performance than the model weights themselves. We'll get there.

Re: Anthropic downgraded cache TTL on March 6th

#354

Earlier quoted context omitted.

> Taking advantage of the $200 plan. No, I'm paying $200 a month for a premium product that I expect premium service for. It's the single most expensive IT expense I have. Taking advantage my foot.

You are simply a bit too entitled. It's not a premium product and honestly not that expensive in my opinion either (though that is going to depend on your location). You are more than able to pay for API rates.

You may want to learn the difference between someone being able to pay API rates and someone willing to pay API rates. I'm sure many people on HN are able to pay API rates and almost all of them aren't willing to pay API rates. The providers know this hence why subscriptions exist. API is almost solely used by companies as almost no private person would be willing to pay that.

Re: Anthropic downgraded cache TTL on March 6th

#355
post #80

Earlier quoted context omitted.

> It's all circumstantial but everything points towards "desperately trying to cut costs". I have been wondering if it's more geared at reducing resource usage, given that at the moment there's a known constraint on AI datacenter expansion capability. Perhaps they are struggling to meet demand?

I wish they would just rip the bandaid to stop everybody's entitled whining. "We're sorry, what we were able to give you for $100/mo before now needs to be $200/mo (or more). We miscalculated/we were too generous/gave too much away for too little. It's a new technology, we are seeing a ton of demand, we are trying to run a business, hope you understand. If you don't want it, don't pay for it."

I would understand the move, but boy would it play right into the "AI is only here to make the rich even richer" feeling wouldn't it?

Re: Anthropic downgraded cache TTL on March 6th

#356
post #221

Anthropic responded: https://github.com/anthropics/claude-code/issues/46829#issue...

This should be the top comment. The OP misunderstands the change and has their LLM write an expose. The company responds with a well-reasoned explanation that it would actually cost MORE money if there was a global 1h default for ALL prompts. It gets downvoted and the pitchforks stay out because…I presume the words like “cache read likelihood” sounds like made up fluff to the audience, rather than an actual explanati…

Because it is made up fluff for this audience. There is a wall of data and evidence + anecdotes from many people pointing to the exact problem here and giving concrete examples of how this absolutely does cost more.

And an admittedly uncharitable TLDR on the response is: "yeah... but most users just ask one thing and barely use the product so they never need the cache. Also trust me bro".

Which sure, fine. I'm willing to bet is technically true. I'd also bet those users never previously came close to hitting their session limits given their usage because their usage is so low. But now people who were previously considered low to moderate users are hitting limits within minutes.

They may as well have just said "we've looked at the data and we're happy with this change because it's a performance improvement for people we make the most margin on. Sucks to be you".

Re: Anthropic downgraded cache TTL on March 6th

#357

Earlier quoted context omitted.

Stop thinking billion dollar publicly traded companies are "cool" just because they make widget you like. You will be backstabbed You will be squeezed for all they can. And you will be betrayed. > Phase N: People can't afford computing anymore. Everything is thin clients and rented. It's become like the private railroad industry. End of the PC era. Like kids growing up on smartphones, there's nothing to tinker with a…

> Stop thinking billion dollar publicly traded companies are "cool" just because they make widget you like. Anthropic is a private company but nevertheless, the sentiment is accurate and applies to all kinds of corporations.

They are already preparing to go public.

But I wrote public because it is at least possible for privately held company to not do all evil (see Steam, tho in case of Steam it is more "do your thing and look as competitors are shooting themselves in foot"...)

Re: Anthropic downgraded cache TTL on March 6th

#358
post #17

On slightly off topic note: Codex is absolutely fantastic right now. I'm constantly in awe since switching from Claude a week ago.

I made this switch months ago, ChatGPT 5.4 being a smarter model, but I’ve had subjective feelings of degradation even on 5.4 lately. There’s a lot of growth in usage right now so not sure what kind of optimizations their doing at both companies

Agreed. Watching the intermediate "Thinking about X ... Now I'll do Y" text on GPT 5.4 lately has been like watching a hypothetical smart drug wear off.

All of the major models have been getting worse lately, not just Opus.

Re: Anthropic downgraded cache TTL on March 6th

#359
post #354

Earlier quoted context omitted.

You are simply a bit too entitled. It's not a premium product and honestly not that expensive in my opinion either (though that is going to depend on your location). You are more than able to pay for API rates.

You may want to learn the difference between someone being able to pay API rates and someone willing to pay API rates. I'm sure many people on HN are able to pay API rates and almost all of them aren't willing to pay API rates. The providers know this hence why subscriptions exist. API is almost solely used by companies as almost no private person would be willing to pay that.

“You may want to learn” such choice way to introduce your position which is really not much of one.

If you are going to come and complain about a $200 subscription that gives you $400 worth of API tokens there is only so much room to complain. Only so many lemons can be squeezed. Hope that was a helpful for you.

Re: Anthropic downgraded cache TTL on March 6th

#360

Earlier quoted context omitted.

I'm currently "working" on a toy 3d Vulkan Physx thingy. It has a simple raycast vehicle and I'm trying to replace it with the PhysX5 built in one ( https://nvidia-omniverse.github.io/PhysX/physx/5.6.1/docs/Ve... ) I point it to example snippets and webdocumentation but the code it gens won't work at all, not even close Opus4.6 is a tiny bit less wrong than Codex 5.4 xhigh, but still pretty useless. So, after reading…

LLMs can really only mostly do trivial things still, they're always going to do very bad work outside of what your average web developer does day-to-day, and even those things aren't a slam dunk in many cases.

I don't know about "only doing trivial things". I've built a fully threaded webmail replacement for Gmail using imap, indexes mail to postgres, local Django webapp renders everything in a Gmail/Outlook style threaded view with text/html bodies and attachments and a better local search than gmail, and runs all locally. Started as a "could I?" and ended up exceeding all my expectations
Post reply on HN