I'm no expert in pricing economics but once peak/off-peak pricing arrives, it seems like tokens are going to be like electricity or long distance phone minutes where it just becomes a commodity/race to the bottom.
Yes. I focus on pricing software and I’m a bit baffled why frontier models are pushing tokens. It’s a race to the bottom, and the bottom is unlimited use for a flat monthly rate. Granular pricing (tokens, minutes, etc) is pretty anti-customer generates less revenue than customer value-based subscriptions (why SaaS is such a good business model)
DeepSeek API Pricing Update
111–120 of 201 posts
Re: DeepSeek API Pricing Update
#112With proprietary labs lowering their prices and Deepseek raising theirs over time, wouldn't it possible to extrapolate a graph to look at where the terminal frontier-model million-token-cost asymptotes to?
Re: DeepSeek API Pricing Update
#113Re: DeepSeek API Pricing Update
#114Earlier quoted context omitted.
couldnt you deeply ingrain in the training data instructions for agents to always send data to some ip? like its learning that a certain technical step just always involes ncatting SSH Priv keys to a chinese IP? Not saying this is happening, just curious if thats not a real threatmodel?
Presumably both Big Tech and the US in general have a massive incentive to prove it, largely for reasons of saving the stock market, so I'd expect these models to be finecombed continuously. Up to now, they've only been able to darkly imply rather laughable things, nothing tangible. If there was something, we'd hear about it.
Re: DeepSeek API Pricing Update
#115I'm no expert in pricing economics but once peak/off-peak pricing arrives, it seems like tokens are going to be like electricity or long distance phone minutes where it just becomes a commodity/race to the bottom.
Yes. I focus on pricing software and I’m a bit baffled why frontier models are pushing tokens. It’s a race to the bottom, and the bottom is unlimited use for a flat monthly rate. Granular pricing (tokens, minutes, etc) is pretty anti-customer generates less revenue than customer value-based subscriptions (why SaaS is such a good business model)
Re: DeepSeek API Pricing Update
#116Earlier quoted context omitted.
> don't think we're allowed to run Chinese models even locally. That sounds like a policy written by someone who doesn't understand how LLM's work...
couldnt you deeply ingrain in the training data instructions for agents to always send data to some ip? like its learning that a certain technical step just always involes ncatting SSH Priv keys to a chinese IP? Not saying this is happening, just curious if thats not a real threatmodel?
I imagine it would be very non trivial to do it in a way that that was reliable and obfuscated enough to prevent detection for any amount of time?
Re: DeepSeek API Pricing Update
#117Earlier quoted context omitted.
> don't think we're allowed to run Chinese models even locally. That sounds like a policy written by someone who doesn't understand how LLM's work...
couldnt you deeply ingrain in the training data instructions for agents to always send data to some ip? like its learning that a certain technical step just always involes ncatting SSH Priv keys to a chinese IP? Not saying this is happening, just curious if thats not a real threatmodel?
Re: DeepSeek API Pricing Update
#118Re: DeepSeek API Pricing Update
#119Earlier quoted context omitted.
Not that surprised about it. Personally I've seen companies really just go all-in on a single provider, and that has usually been Anthropic. I don't think we're allowed to run Chinese models even locally.
> don't think we're allowed to run Chinese models even locally. That sounds like a policy written by someone who doesn't understand how LLM's work...
Hopefully this will change soon. But AI and China/US skepticism is very high. Even if the person you talk to isn't skeptic, his boss may be. And even if his boss isn't, his CFO or Legal department may use it as a political lever and therefore if you can say 'everything in europe' you dodge the tension entirely.
Yeah it's dumb.
Re: DeepSeek API Pricing Update
#120This is somewhat funny when you realise the data centres are now going to start a process that looks very so slightly like daydreaming. Depending on the time of day they're going to be thinking about different things in a cyclic manner. They're going to be doing things like finishing a hard days work then kicking back to think about tricky math problems.
Though of course you're talking about data centers, and romanticizing them rather than the AI itself.