Earlier quoted context omitted.
Parts of it (e.g. water consumption per query) are overblown. But the degree of data center buildout and resource use, if exponential growth just continues a little longer, is going to end up being a big number. AI datacenters are already stretching electrical power grids and increasing peaker power plant use. Data centers right now are about 5% of electricity use in the US. AI could easily double that share.
I was thinking about this the other day. Surely, a datacenter, even one optimized for machine learning workloads could switch gears and do other kinds of computations. Even if the bubble were to pop, i feel like the worst that could happen is that we would have a bunch of inactive datacenters that could be switched on to meet demands of the growing internet. Kind of like how nuclear plants operate. cmiiw to think alo…
- AI datacenters are gold-rush rush jobs with interesting things like their own gas turbine generators etc.
- It's not clear that serving the internet needs us to double the amount of datacenter footprint. If anything, a lot of workloads are getting more power and space efficient.
- Most expensive thing is that we're filling them full of GPUs and with RAM tied up to the GPUs. That's infrastructure that we've paid the resource costs for and it's difficult to repurpose to something else.
I do think AI is going to grow a lot, so I'm not sure how much of the buildout will need repurposing. But I do think doubling our datacenter footprint and doing it in environmentally yucky ways will probably have some lasting effects and consume a lot of resources.