Live data from Hacker News

US tech firms pledge at White House to bear costs of energy for datacenters

theguardian.com

171–180 of 265 posts

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#171
post #149

The training data commons is to AI what oil reserves are to petroleum economies: a collectively generated resource of immense commercial value. Every book written, every forum post answered, every photo shared, every line of code contributed... billions of people built the knowledge base that makes these models work. Without that collective human output, AI is nothing. Alaska and Norway understood something critical…

This framing is hardly fair, since it treats AI as an incinerator of knowledge rather than the democratizer of knowledge that it is.

Every human uses that "resource" to train themselves, and now they use AI to supercharge that consumption.

The companies are giving average lay people access to a personal PhD to help with whatever they are working on, for $20/mo, and those companies are committing an evil cardinal sin?

I get the gatekeepers are pissed, LLMs are way cheaper than those expensive gate fees, and I cannot come up with a good faith argument about how giving the power of SOTA LLMs to anyone for $20/mo is somehow evil or bad.

In an alternate universe these same models are $100k/mo with limited invite only access, occasionally the public gets a single demo prompt with a short reply, and $20/mo access is a utopian wet dream.

If you want UBI, then the framing shouldn't be around "whoever had content on the internet circa 2024 is entitled to lifetime AI company payouts that effectively act as permanent unemployment checks."

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#172
post #149

The training data commons is to AI what oil reserves are to petroleum economies: a collectively generated resource of immense commercial value. Every book written, every forum post answered, every photo shared, every line of code contributed... billions of people built the knowledge base that makes these models work. Without that collective human output, AI is nothing. Alaska and Norway understood something critical…

You can only use each barrel of oil once, so it is not remotely the same thing. It's like torrenting a movie vs stealing someone's car. My labor has been compensated and nothing has been extracted.

Fair point, data isn't scarce like oil. Nobody's losing their forum posts. That part of my analogy is weak.

But you're answering a question I'm not asking. The question isn't "was something taken from you." It's "who deserves a share when collective human output generates trillions in commercial value."

your torrenting analogy makes my case. Nobody loses their original movie when it gets pirated either. We still recognize that the people who made it deserve compensation when others profit from it. The entire IP enforcement apparatus is built on exactly that principle.

Non-rivalrous doesn't mean non-exploitable.

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#173

Earlier quoted context omitted.

> The tech companies don't really have any issue paying It reduces profit.

Wrong, using grid power without adding capacity will result in tech companies paying more for electricity too. They want to add capacity.

Are you absolutely sure they don't want us to add the capacity for them with a pathway for further government subsidies?

Almost everything in tech has been subsidized in one way or another via tax avoidance schemes or outright lobbying and manipulation of the market.

Why would this be any different?

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#174
Terrific if it happens. I may even ignore the AI (valuation) bubble for the duration.

David Roberts (https://volts.wtf) has repeatedly noted that AI companies need the power, need it now, and have the capital to get it. So he (and others) advocate that Big Tech fund the grid improvements and new power generation.

Point #1 Virtual Power Plants

Roberts advocates adopting virtual power plants (VPPs). Think grid of grids, like the internet is a network of networks. Think peer-to-peer energy sharing. VPPs unlock dynamic load shifting, two-way energy sharing (think of all those roof top solar panels and powerwalls), and therefore -- most importantly -- reduces peak demand on a grid which will allow greater utilitization.

IIRC: our grids currently operate at 30% capacity (to accommodate rare peak demand events). Grid enhancement techs plus VPPs can boost that to 80% or higher. Reducing the urgency for building more transmission and distribution infra. (In the short term; we still need to greatly embiggen our grid(s).)

It'd be kinda amazing if the urgency to build more data centers mooted the incumbent's (utilities, regulators) opposition to improving our grid(s), thereby benefiting everyone everywhere.

Tangent: there's a backlog of grid enhancing technologies available, just waiting for funding and incentives to line up.

Tangent: VPPs also enable new financial products, which will further accelerate electrification (of All The Things).

Point #2 Solar + Battery

Solar + battery is the fastest, cheapest way to get new power generation. More so every year.

Yes, we still need to massively invest in All The Things to reach Net Zero and beyond. Wind, geothermal, nuclear (fission and fusion), hydro, every flavor of storage, de-carbonize industry and agriculture, conservation, rewilding, and everything else.

But at this moment in time, today, we need gigawatts of new generation and the grid that can support it. That means solar + battery.

Aside, IIRC, data centers are projected to demand just 5% our electricity supply. So society will be the net beneficiaries (on this axis).

Were Big Tech to fund the generation and grid that we need, maybe society will indulge some of Big Tech's less egregious offenses. https://en.wikipedia.org/wiki/Indulgence

Important Point: the rising costs of transmission, distribution, and fuel costs account for electricity's higher prices. New renewable power generation is now the cheapest option, and getting cheaper. The challenge is delivering that cheap electricity to customers.

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#175
post #149

The training data commons is to AI what oil reserves are to petroleum economies: a collectively generated resource of immense commercial value. Every book written, every forum post answered, every photo shared, every line of code contributed... billions of people built the knowledge base that makes these models work. Without that collective human output, AI is nothing. Alaska and Norway understood something critical…

You can only use each barrel of oil once, so it is not remotely the same thing. It's like torrenting a movie vs stealing someone's car. My labor has been compensated and nothing has been extracted.

How is an author fairly compensated when you torrent their book? Should we just stop paying for media because it's infinitely reproducible?

Nothing physical is being stolen when a company makes a clone of a product based on another company's designs, but that doesn't mean we shouldn't have patent laws.

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#176
post #149

The training data commons is to AI what oil reserves are to petroleum economies: a collectively generated resource of immense commercial value. Every book written, every forum post answered, every photo shared, every line of code contributed... billions of people built the knowledge base that makes these models work. Without that collective human output, AI is nothing. Alaska and Norway understood something critical…

This framing is hardly fair, since it treats AI as an incinerator of knowledge rather than the democratizer of knowledge that it is. Every human uses that "resource" to train themselves, and now they use AI to supercharge that consumption. The companies are giving average lay people access to a personal PhD to help with whatever they are working on, for $20/mo, and those companies are committing an evil cardinal sin?…

It's not democracy if you can't destroy it. It's not democracy if the citizens cannot reject it. It's not democracy if it's being forced down your throat.

Sick of how SV/VC absolutely ruin words for their own monetary benefit.

How about you put up it up to a national vote and see what democracy gets you? I highly suspect that vast majorities of the electorate would want to nationalize this tech to benefit everyone rather than benefiting the few.

Democracy means there is a politics of rejection, rejection is normal in functioning democracies; what isn't normal are small handfuls of people capturing all collective human intelligence then claiming only they are allowed to benefit from it.

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#178

Earlier quoted context omitted.

So what’s the solution? No data center? Let the current landscape of power companies operate as is?

Let's make some assumptions first: 1. DCs must be built anyway 2. You can't take away energy from households (3). Highly preferred that you are not going to impact cost negatively to households (otherwise why we have this discussion) based on these assumptions, solution I see is, BigTech subsidising energy costs for 10 years for nearby households (area will be geofenced, e.g. in the radius of 50km), subsidy will be b…

Power prices have nearly nothing to do with proximity like that, at least in most areas. Local interconnect surcharges are a thing, but not usually material.

It's the entire region where prices will increase. A facility could be built 200 miles away from you and it would have just as much of an impact on your power bill as one built across the road.

> Also BigTech is not going to build the power generation plants, it must be built by existing processes to minimize impact on pricing

The issue with this requirement is that it's not a capital problem. Big tech would be happy to pay someone to build more power generation and just take a power feed, even if it costs marginally more.

What they cannot do is wait 12 years for what they could get done in 2. And I do not blame them at all for this at all - building anything in the US is basically impossible these days due to the NIMBY and general culture of not getting things done. We forgot how to rapidly build infrastructure in an efficient manner, and anyone putting proverbial boot to ass to get this done is a good thing.

It's not a case of a datacenter operator wanting to save a few pennies per kwh. It's a case of the power literally not being there and the utilities being utterly incompetent at building anything in any reasonable timeframe.

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#179

Earlier quoted context omitted.

This framing is hardly fair, since it treats AI as an incinerator of knowledge rather than the democratizer of knowledge that it is. Every human uses that "resource" to train themselves, and now they use AI to supercharge that consumption. The companies are giving average lay people access to a personal PhD to help with whatever they are working on, for $20/mo, and those companies are committing an evil cardinal sin?…

It's not democracy if you can't destroy it. It's not democracy if the citizens cannot reject it. It's not democracy if it's being forced down your throat. Sick of how SV/VC absolutely ruin words for their own monetary benefit. How about you put up it up to a national vote and see what democracy gets you? I highly suspect that vast majorities of the electorate would want to nationalize this tech to benefit everyone ra…

Democratize means to make something available to everyone.

I suppose the root of the word is from democracy, everyone gets a vote/equal rights, but the meaning doesn't really have anything to do with politics or government...

So to reframe my argument for clarity;

I have a hard time coming up with an honest critique of why giving everyone incredibly cheap access (often free!) to incredibly powerful LLMs is somehow evil. And obviously these things are ridiculously popular. Average people seem to think they are fucking awesome, and anger seems to be mostly from gatekeepers that are relentlessly screaming that their gates are being bypassed for pennies.

Re: US tech firms pledge at White House to bear costs of energy for datacenters

#180

Earlier quoted context omitted.

>like especially if they do what they have been doing recently (run their own generator, build their own power planes) a lot of this cost is implicit and as such very dodgeable. E.g. higher cost for gas power planes for other due to major increase of demand, higher medical cost due to more air pollution, higher fuel prices, etc. etc. (not even speaking about anything climate change). And it's not just data centers, i…

I promise you, the City Engineer is aware of the bullshit. You catch a whiff, but they live in the stink. It's been clear for a while that there's conflicting interests and the only real way to fix it is to change incentives. However, if you're insinuating that the Clean Water Act is made by "slimy politicians and big picture ignoring environmentalists" then you're wrong. That's about the best common sense environmen…

>However, if you're insinuating that the Clean Water Act is made by "slimy politicians and big picture ignoring environmentalists" then you're wrong. That's about the best common sense environmental reform in the last 100 years aside from removing lead from gas.

I'm more than insinuating it. The cause may be noble but the state and local implementations have been perverted by all the minutia and business interests and NIMBYism. I would go so far as to say that (state and local implementation of requirements within) the clean water act is a non-negligible contributor to the decline of manufacturing and agriculture in the northeast and upper midwest.

We basically took "thou shalt not dump for that is bad for our surface and ground water" and over 50yr turned it into a blank check for all manner of leeches to make a buck and all manner of NIMBYs to make things unnecessarily expensive.

Petty 1.5-acre "I want my lightly forested former field to be a field again" and "business is going great I want my gavel parking lot paved" being stalled by five figure costs and even with those costs incurred it doesn't guarantee compliance. That's a far cry from the "yeah we just dump this stuff in a settling pond, IDK where it goes after that but man that river over there sure is a weird color" type 1960s industry behavior that it was meant to really curb. And the big industrial offenders still get to do what they want, not as bad as before of course, but still bad. Some Megacorp's runoff might turn the fish neon green or their 1k unit condo development might turn the river brown with silt but of course they'll be right there with their lawyers and experts who'll tell you why it's fine even when it's not to anyone with a brain and two eyeballs. The layman can't pay off people like that be on their side and neither can the regulators. (I assume this frequent fact pattern what you refer to by "living in the stink")

I think it ought to be revamped at the state and local level into something that's substantially more "results based" rather than the proactive red tape "make the bureaucrats feel like their ass is covered if someone ever complains about what they approved" based system we have now.

(And just to be clear for any readers who aren't familiar, the clean water act basically doesn't do much to affect the average person or business at a federal level. The local implementations and all the key definitions, industry standards, etc, are where the rubber really meets the road)

Edit: Basically I'm saying that in the past 50yr the interests the CWA was supposed to stymie learned how to pay their way around it, the parties who make a buck doing that have gotten themselves all but written into the compliance process to the detriment of the interests the CWA was supposed to not seriously burden. It needs to be replaced or revised to solve those two big problems.

Post reply on HN