[dead]
DeepSeek announced to raise its API price tremendously
31–35 of 35 posts
Re: DeepSeek announced to raise its API price tremendously
#32It's exactly this. Not only this, we might be running very soon into cheap compute soon given the current CAPEX of all hyperscalers. DeepSeek is model that you can run anywhere, meaning that any datacenter/company could run it at a price that would give them a margin taking in account running costs of the datacenter + depreciation. I'm very sure we're overbuilding capacity, and we'll find out around 2027. Those open…
Interesting perspective. Things are definitely going to change and open weight will have a huge impact in the US as token costs are way to high now. Definite impacts to Anthropic/OpenAI but let's not forget Meta and Grok are out there too and same with Gemini. Infrastructure costs - great points. Are we really going to have datacenters in space? If so, what will be overall cost structure with launch being the new cos…
> Are we really going to have datacenters in space
I haven't properly thought through the thermal engineering problems here but cooling a data center in the vacuum of space seems like a hard thing to solve.
There are plenty of computers on the ISS and on satellites in space, but nothing on the same scale of compute and density.
Re: DeepSeek announced to raise its API price tremendously
#33It's exactly this. Not only this, we might be running very soon into cheap compute soon given the current CAPEX of all hyperscalers. DeepSeek is model that you can run anywhere, meaning that any datacenter/company could run it at a price that would give them a margin taking in account running costs of the datacenter + depreciation. I'm very sure we're overbuilding capacity, and we'll find out around 2027. Those open…
As a ML/LLM engineer in a ecommerce analytics SaaS company, I can't stress how useful LLMs are for me, and gladly - for a 5-man company our LLM expenses are 1.5k including coding agents. Great ROI.
how are you measuring ROI? Are LLM products driving revenue?
Re: DeepSeek announced to raise its API price tremendously
#34Earlier quoted context omitted.
Interesting perspective. Things are definitely going to change and open weight will have a huge impact in the US as token costs are way to high now. Definite impacts to Anthropic/OpenAI but let's not forget Meta and Grok are out there too and same with Gemini. Infrastructure costs - great points. Are we really going to have datacenters in space? If so, what will be overall cost structure with launch being the new cos…
> Are we really going to have datacenters in space I haven't properly thought through the thermal engineering problems here but cooling a data center in the vacuum of space seems like a hard thing to solve. There are plenty of computers on the ISS and on satellites in space, but nothing on the same scale of compute and density.
The new thing is data centers in the ocean.
Re: DeepSeek announced to raise its API price tremendously
#35Within a year or two when "good enough" models collide with personal hardware capable of running said models, it all inevitably collapses (and Apple stands on top of the pile of rubble with a construction hat on labeled: "told ya so").