Earlier quoted context omitted.
Well I can answer one question for you. There are studies that show that better insulation only briefly lowers the energy use. Once people adjust to the new insulation they end up heating or cooling their houses more since in their mind it is cheaper, but they end up using the same or more energy. https://www.cam.ac.uk/research/news/insulation-only-provides...
presumably there are limits to that. once every room is the preferred temperature, i'm going to stop running the heater although maybe i'd get bored and run the heater and the AC at the same time
Jevons paradox
61–70 of 165 posts
Re: Jevons paradox
#62Earlier quoted context omitted.
new method was 1,000,000x more efficient would there still be more total money spent on GPUs because of it In my opinion, yes. If scaling laws continue at 1,000,000x, we will turn the whole planet (or Mercury) into a giant GPU.
Do you have a use case for your opinion? On the assumption that we’d want super intelligence to do interesting things, consider that we currently have many very smart humans and society is not maximizing their use, quite the opposite.
Re: Jevons paradox
#63The dose makes the poison, what if a new method was 1,000,000x more efficient would there still be more total money spent on GPUs because of it. What if efficiency brought it down such that inference on CPUs that people already have is good enough. I see a large demand curve but not an infinite one. For example laptops are getting faster every year but most people I know are not clamoring for the latest laptop, same…
> what if a new method was 1,000,000x more efficient would there still be more total money spent on GPUs because of it Obviously yes; 6 orders of magnitude would result in insane amounts of money swooping in. The market has currently been going crazy over relatively minor improvements compared to that. > If a laptop came out that was 50x faster for the same price people wouldn’t buy 50x more laptops, they would wait…
Yeah, it would be super impressive, perhaps another point SMT solvers algorithms have improved faster than the hardware for a very long time and are incredibly useful. But we are not spending infinite money on SMT solvers, quite the opposite.
Re: Jevons paradox
#64Where was Stargate gonna get $500B? How was Altman ever going to raise.. $7T? (~1/3 of the entire GDP of US)
Does a 10x or even 40x decrease in compute cost just mean they can actually raise & spend the capital that their compute requires?
Re: Jevons paradox
#65Earlier quoted context omitted.
Having read the paper from deepseek I seriously don't get how anyone can think "Oh now is the time to sell nvidia". Both at the tactical level and strategic level that paper means we will see _more_ nvidia gpus fly off the shelves. If anything it's showing why the h800 is a decent card and everyone in China should buy one (dozen thousands).
But, I thought the CUDA moat is primarily needed for training. On the inference side, why does one need Nvidia GPUs over Intel and AMD GPUs?
Re: Jevons paradox
#66Earlier quoted context omitted.
Do you have a use case for your opinion? On the assumption that we’d want super intelligence to do interesting things, consider that we currently have many very smart humans and society is not maximizing their use, quite the opposite.
Very smart humans don't want to do random tasks, they want to study number theory.
Re: Jevons paradox
#67Earlier quoted context omitted.
> what if a new method was 1,000,000x more efficient would there still be more total money spent on GPUs because of it Obviously yes; 6 orders of magnitude would result in insane amounts of money swooping in. The market has currently been going crazy over relatively minor improvements compared to that. > If a laptop came out that was 50x faster for the same price people wouldn’t buy 50x more laptops, they would wait…
Hence my very first point; the dose makes the poison. Yeah, it would be super impressive, perhaps another point SMT solvers algorithms have improved faster than the hardware for a very long time and are incredibly useful. But we are not spending infinite money on SMT solvers, quite the opposite.
Re: Jevons paradox
#68Earlier quoted context omitted.
Hence my very first point; the dose makes the poison. Yeah, it would be super impressive, perhaps another point SMT solvers algorithms have improved faster than the hardware for a very long time and are incredibly useful. But we are not spending infinite money on SMT solvers, quite the opposite.
But we are spending more than ever before. I don't see why you think being unable to spend infinity dollars matters here. There are a lot of numbers between larger than current spend between where we are and infinity.
Re: Jevons paradox
#69Jevons Paradox Paradox: Markets fall on news that should make them rise, due to Jevons Paradox.
Somehow, nobody expects the Jevons' Paradox. Even when those same people talk about it every other day.
Re: Jevons paradox
#70Earlier quoted context omitted.
But we are spending more than ever before. I don't see why you think being unable to spend infinity dollars matters here. There are a lot of numbers between larger than current spend between where we are and infinity.
To my point, how much do you think a SMT solution costs now?