How much is a 10 year old GPU worth? Where is the “dwdm but for GPUs?”.
There truly are interesting times and we have the benefit of being in them.
161–170 of 218 posts
How much is a 10 year old GPU worth? Where is the “dwdm but for GPUs?”.
There truly are interesting times and we have the benefit of being in them.
Earlier quoted context omitted.
>With Bezos openly stating the goal to build 10 GW+ data-centers in space, it almost feels in question whether this is about ROI, or simply building the Neuromancer future where the ultra-rich can finally be free of their need for the rest of us. Not needing labor at all would be the final return on investment. Why does "Not needing labor at all" need to be in space?
It's so the billions of disgruntled former workers can't storm the castle.
Earlier quoted context omitted.
>Meanwhile LLM fatigue has started to set in Has it? I think there is this compulsion to think that LLMs are made for senior devs, and if devs are getting wary of LLMs, the experiment is over. I'm not a programmer, my day job isn't tech, and the only people I know who express discontent with LLMs are a few of programmer friends I have. Which I get, but everyone else is using them gleefully for all manner of stuff. An…
You should get on Reddit, people hate AI with a passion there. People I meet in real life hate it also. I think the public actually hates AI more than it should now.
Really?! I'm not used to chips having such a short lifespan.
> Evidence from Google architects shows GPUs at 60-70% utilization survive 1-2 years , with 3 years maximum. Really?! I'm not used to chips having such a short lifespan.
> Evidence from Google architects shows GPUs at 60-70% utilization survive 1-2 years , with 3 years maximum. Really?! I'm not used to chips having such a short lifespan.
This sounds like major FUD unless the data is public.
Additionally - GPUs have multiple components. Which parts are at 60-70% load, the SM unit or the memory controller? If you're throttling the GPU but not the memory, it makes perfect sense why you're burning the damn card out...
Earlier quoted context omitted.
> I doubt we will see unused GPU capacity I'd argue we very certainly will. Companies are gobbling up GPUs like there's no tomorrow, assuming demand will remain stable and continue growing indefinitely. Meanwhile LLM fatigue has started to set in, models are getting smaller and smaller and consumer hardware is getting better and better. There's no way this won't end up with a lot of idle GPUs.
Your bet is that people will simply use less compute , for the first time in the history of the human race?
Earlier quoted context omitted.
Capitalism only works if there is lots of competition. Monopolies gum up the system, reward the institutional capital rather than innovation capital, and prevent new entrants from de-ossifying and being the renewing forest fire. We've been so lax on antitrust. Google, Apple, Meta, Amazon - they all need to be broken up. Our economy and our profession would be better for it. Innovation should be a treadmill. YC and a1…
I don't agree with everything in this book, Goliath,[0] but his main argument was that business monopoly and democracy are in direct opposition. And that since the 1970s we've chosen to enable monopoly again and again. 0: https://www.amazon.com/Goliath-100-Year-Between-Monopoly-Dem...
This is surely the most important line in the piece? In what world would this much demand not lead to alternatives emerging?
(Assuming the upside, yes if the demand is not there in two years then yes it’s all going to burn)