> Models require massive amounts of electricity and water (to cool servers). Does it? https://prospect.org/environment/2024-09-27-water-not-the-pr... > training GPT-3 used as much water as just under twice what is required for the average American’s beef consumption. In other words, just two people swearing off beef would more than compensate. https://andymasley.substack.com/p/a-cheat-sheet-for-conversa... > It would…
I don't understand the "whatboutism" angle. Running LLMs requires massive amounts of electricity and water. Period. That beef consumption and other activities also require massive amounts of resources is independent. Both can be true. And both need to be addressed. We no longer have the luxury to pick and choose which climate interventions we find most convenient; we need to succeed on all fronts. If the patient is d…
Datacenters' used for training or batch jobs can be placed in places where water and power are plentiful, ambient temperature are relatively low and government/society are stable.
A datacenter is going to be built at the bottom of New Zealand where all these things are true. There must be plenty of places in the world where this holds true.
At least for training, I think it is possible to have our cake and eat it. For real-time inference, probably not.