Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

sunkcost.ai

Post reply on HN
Print view View original

11–20 of 91 posts

Re: Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

#11

Post by chasd00 »

Not a fair comparison really. If you can run a model locally then you can somewhat train out the guardrails, censorship, and brand-safety. That has value a subscription does not.

Idk about the quality of this setup but just pasting it here as an example. https://explainx.ai/blog/heretic-llm-abliteration-guide-2026

Re: Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

#12

Post by ThunderSizzle »

Claude Code is $100+ or else be constantly throttled. My usage on GHCP was gonna be $300+ a month.

I paid $1350 and threw an R9700 in an existing machine. That's a 4 month pay off or so.

Plus, I can feed it sensitive data all day and not be worried where it's going.

Re: Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

#13

Post by no-name-here »

txrx0000 wrote: post #8

It pays off instantly , because OpenAI/Anthropic can no longer see what I'm doing and that's worth a lot of money to me. If I am offloading some of my thought processes to a machine, I want to own that machine. And if I finetune the model, I can gain access to parts of thought space that are cordoned off by OpenAI/Anthropic/Alibaba/whomever due to their "alignment" efforts (i.e. alignment to the AI company rather tha…

You can't run recent openAI/Anthropic models locally anyway, so wouldn't a better comparison be a different provider running Qwen or similar model? As then you can also compare against the exact model you'd have locally and any different data privacy of that particular provider?

Re: Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

#15

Post by QwenGlazer9000 »

Yeah no it does not pay for itself just comparing to cloud. Not at these prices at least, people far richer than you or I buy these things wholesale, no scalper, bought a significant amount at cheaper prices, and are wired up the ass with VC money.

The premium is not having your million dollar prize and career stolen by billionaires.

Re: Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

#16

Post by ChickeNES »

chasd00 wrote: post #11

Not a fair comparison really. If you can run a model locally then you can somewhat train out the guardrails, censorship, and brand-safety. That has value a subscription does not. Idk about the quality of this setup but just pasting it here as an example. https://explainx.ai/blog/heretic-llm-abliteration-guide-2026

> If you can run a model locally then you can somewhat train out the guardrails, censorship, and brand-safety.

When does the average person actually need to do that?

Re: Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

#17

Post by no-name-here »

ThunderSizzle wrote: post #12

Claude Code is $100+ or else be constantly throttled. My usage on GHCP was gonna be $300+ a month. I paid $1350 and threw an R9700 in an existing machine. That's a 4 month pay off or so. Plus, I can feed it sensitive data all day and not be worried where it's going.

An R9700 has 32 GB RAM. Is your comparison against a similar size model? Or shouldn't you be comparing it against the cost of a hosted model matching the one you’re using locally?

Re: Show HN: Sunk Cost – How long until a local LLM rig pays for itself?

#19

Post by txrx0000 »

no-name-here wrote: post #13
txrx0000 wrote: post #8

It pays off instantly , because OpenAI/Anthropic can no longer see what I'm doing and that's worth a lot of money to me. If I am offloading some of my thought processes to a machine, I want to own that machine. And if I finetune the model, I can gain access to parts of thought space that are cordoned off by OpenAI/Anthropic/Alibaba/whomever due to their "alignment" efforts (i.e. alignment to the AI company rather tha…

You can't run recent openAI/Anthropic models locally anyway, so wouldn't a better comparison be a different provider running Qwen or similar model? As then you can also compare against the exact model you'd have locally and any different data privacy of that particular provider ?

Technically true, but the delay between local and closed frontier is only a few months. And individual sovereignty / digital bodily integrity is almost priceless.
Post reply on HN