Paying for LLM inference by the kilowatt-hour instead of per token
1–2 of 2 posts
Re: Paying for LLM inference by the kilowatt-hour instead of per token
#2AI is an energy problem.
Marketplace success will likely be determined by energy costs as much if not more so than the technical aspects of model development.