Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

twitter.com

Post reply on HN
Print view View original

61–67 of 67 posts

Re: DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

#61

Post by monster_truck »

edgyquant wrote: post #44
monster_truck wrote: post #32

I'd really rather just pay Deepseek directly. Why wouldn't I want to support the company that trained the model? It isn't even really worth the (minimal) ops to stand up rented MI300Xs to sell excess capacity to them even if it was minimally profitable, when I tried I was content to give API keys to friends to beat on it.

You can do this but you still need a harness. I like open code because I can use literally any model through it and can connect directly to the provider (although I use open router)

We just use moonbridge and codex. It's way cooler when all the log messages are in chinese

Re: DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

#62

Post by infecto »

JHonaker wrote: post #36
infecto wrote: post #21

Earlier quoted context omitted.

Probably less of an issue but I always disliked with their paid plan/credits that they made I nonobvious that some of the Chinese models train off of your usage. It may have changed now but they would show all these great models you could use, somewhere have a bullet that everything is private adobe have an asterisk next to a handful of those models (including their own). I am sure some cost sensitive folks are ok wi…

You have to enable explicit opt-in to use models hosted in China now. This changed in July +/- 2w. I already used DeepSeek, but it was nice to make that explicit for people that were concerned.

Which is a step in the right direction but for the “built for privacy first” harness they miss the mark.

Re: DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

#63

Post by echelon »

fancyfredbot wrote: post #15
echelon wrote: post #4

Cloud > Local I have a stack of ten or so 3090s sitting in boxes, but it's not worth the hassle to use them. You can easily run models as cheap as water in the cloud. Sitting around 15 minutes for local Minimax is stupid when you're trying to be productive. You can spin up parallel job instances and multitask in the cloud. If you want freedom, build open source cloud infra. You rent your ISP line. Why isn't renting G…

Why do you have ten or so 3090s sitting in boxes? I mean obviously it's worth it just so you can flex on HN. But curious whether there was any other reason? Retired scalper?

I ran a popular gen AI audio website on them as an on-prem GPU cluster. 6.5M MAU with $650k ARR at peak. Half the inference happening locally.

We got destroyed by bigger players (ElevenLabs, Suno, and more recently Fish) that fundraised and had better in-house models.

It was a headache to run, I wanted to pursue a different market (video/creative), and I pivoted.

My pivot failed and was dead for over a year as I went too far into controllability. One of my changes then got a semblance of PMF and it's doing $4M annualized run rate (but it's not fundable in its current shape).

I ultimately want to build open source cloud infra and open source workflow products - more friendly than Comfy, more free than RunPod.

In any case, I can't run my current work on the GPUs. But I'm close enough to pretraining and fine tuning smaller models that I want to use them for future experiments. Not that I wouldn't do that in the cloud.

Re: DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

#64

Post by stasomatic »

monster_truck wrote: post #32

I'd really rather just pay Deepseek directly. Why wouldn't I want to support the company that trained the model? It isn't even really worth the (minimal) ops to stand up rented MI300Xs to sell excess capacity to them even if it was minimally profitable, when I tried I was content to give API keys to friends to beat on it.

There is some fear mongering, because - China. I wouldn't want to send even the dumbest of my half assed of my ideas to their servers... but then, could be a vector for some shenanigans... but, then as if we have a reasons to trust either Sam or Dario. IDK, but interesting to think about.

Re: DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

#65

Post by echelon »

hluska wrote: post #31
echelon wrote: post #4

Cloud > Local I have a stack of ten or so 3090s sitting in boxes, but it's not worth the hassle to use them. You can easily run models as cheap as water in the cloud. Sitting around 15 minutes for local Minimax is stupid when you're trying to be productive. You can spin up parallel job instances and multitask in the cloud. If you want freedom, build open source cloud infra. You rent your ISP line. Why isn't renting G…

Do you really keep ten cards in boxes just to brag on Hacker News? Geez, our industry has gotten pathetic.

They ran production on-prem inference for millions of users on one of my older projects, but I've moved on from that and they're impractical for my current work.

Re: DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

#66

Post by cyanydeez »

perarneng wrote: post #13

The reason to run local models is not for coding mostly it's for learning how to deploy models and tinker with self hosting. It's also for massively crunching data 24/7. Imaging having an agent analyzing constinous log streams etc .. that could be a usescse where even deepseek could add up cost.

For me its stability and workflow.

Models are all non deterministic and local is the only gauntee that your investment can continue to pay.

Cloud models will continually change nondeterminism ontop of the model.

Re: DeepSeek costs OpenCode Go user $1.14/day; dual DGX breaks even in 24 years

#67

Post by fancyfredbot »

echelon wrote: post #63
fancyfredbot wrote: post #15

Earlier quoted context omitted.

Why do you have ten or so 3090s sitting in boxes? I mean obviously it's worth it just so you can flex on HN. But curious whether there was any other reason? Retired scalper?

I ran a popular gen AI audio website on them as an on-prem GPU cluster. 6.5M MAU with $650k ARR at peak. Half the inference happening locally. We got destroyed by bigger players (ElevenLabs, Suno, and more recently Fish) that fundraised and had better in-house models. It was a headache to run, I wanted to pursue a different market (video/creative), and I pivoted. My pivot failed and was dead for over a year as I went…

Thanks very interesting. Can imagine it being a pain.Ten is an unusual number, hard to divide evenly across hosts.

To be honest I doubt you'll ever use them again, especially if you have dismantled the cluster and put them back in their boxes again. The cluster would be cheaper than cloud but you don't seem that cost constrained.

Post reply on HN