Arbitraging Down LLM Inference to the Cost of Electricity
1–5 of 5 posts
Re: Arbitraging Down LLM Inference to the Cost of Electricity
#2frontier labs are still making crazy margins. OSS models are impossible to host serverlessly at a profit even if you're Together
Re: Arbitraging Down LLM Inference to the Cost of Electricity
#3Why is there nowhere on the site where I can figure out how much I would get paid by adding my GPU to the network?
Re: Arbitraging Down LLM Inference to the Cost of Electricity
#4Why is there nowhere on the site where I can figure out how much I would get paid by adding my GPU to the network?
That's exactly I was thinking.
Re: Arbitraging Down LLM Inference to the Cost of Electricity
#5> Someone with cheap electricity can serve inference profitably at prices that would bankrupt the current small set of centralized providers.
Strong claim, There's a similar article about China is eating the world on HN. Maybe then, they're the ones who can take over the inference cloud?