Earlier quoted context omitted.
Given how much energy LLMs use, I'd greatly prefer not to let the results speak for themselves.
Quick napkin math time! Steam reached a new peak of 42 million concurrent players today [1]. An average/mid-tier gaming PC uses 0.2 kWh per hour [2]. 42 million * 0.2 gives 8,400,000 kWh per hour, or 8,400 MWh per hour. By contrast, training GPT3 was estimated to have used 1,300 MWh of energy [3]. This does not account for training costs of newer models, nor inference costs. But we know inference costs are extraordin…
Who lied to you and told you this was some kind of saving gotcha??