Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I put a datacenter GPU in my gaming PC

blog.tymscar.com

Post reply on HN
Print view View original

21–30 of 199 posts

Re: I put a datacenter GPU in my gaming PC

#21

Post by echelon »

jmyeet wrote: post #6

Some context: - In 2017, the v100 was a ~$10,000 GPU. I believe there was a PCI-e version but this is probably so cheap because SXM2 is going to be harder to use; - A 5090 has 1800GB/s of internal memory bandwidth (compared to 900GB/s in the 9 year old GPU). Of course a 5090 is substantially more expensive; - A 5090 has ~21k CUDA cores vs ~5k; - The current $10k NVidia GPU is the RTX 6000 Pro w/ 96GB of VRAM. It has…

> Consider this: in 5-10 years, the trillions spent on AI data centers will likewise be sold for scrap most likely. That's how short the runway is for OpenAI and Anthropic to recover that investment.

Even more interesting: it'll devalue all of SaaS and the entire US tech sector.

We might have just shot our most valuable non-AI tech products in the foot.

Re: I put a datacenter GPU in my gaming PC

#22

Post by Alifatisk »

casey2 wrote: post #9

Some resell group is going to have to make this easier. The shear amount of these cards otherwise heading towards the landfill is staggering. That is if Big Tech don't destroy them to prevent model weights from leaking.

> The shear amount of these cards otherwise heading towards the landfill is staggering.

The thought of throwing away working cards sounds so bizarre to me. I can't believe companies would dispose them into the landfill like that, it is at least worth giving away for refuse.

Re: I put a datacenter GPU in my gaming PC

#23

Post by alehlopeh »

postalrat wrote: post #8
lelanthran wrote: post #3

> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Because humans write exactly like this /s

Where do you think llms learned to write that way?

Marketing content.

Re: I put a datacenter GPU in my gaming PC

#24

Post by m0rde »

recursivegirth wrote: post #19

> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Had to stop there. Annoying. I can't stand AI use for writing. It makes any otherwise great article feel so disingenuous.

What a difficult world you must live in these days

Re: I put a datacenter GPU in my gaming PC

#25

Post by mickeyp »

Impressive work. But the problem is not the 30 tok/s which is fine for agentic coding and chat.

It's prefill; slow prefill kills agentic workloads dead.

If you have 100,000 tokens at ~150tok/s per the OP, you're looking at:

    You have: 100000 / (150/s)

    You want: hms

     11 min + 6.6666667 sec
Which is quite a wait indeed.

Re: I put a datacenter GPU in my gaming PC

#26

Post by driverdan »

lelanthran wrote: post #3

> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Because humans write exactly like this /s

There's interesting stuff in this writeup but it sure seems like most of it was written by an LLM.

Re: I put a datacenter GPU in my gaming PC

#27

Post by jlund-molfese »

postalrat wrote: post #8
lelanthran wrote: post #3

> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Because humans write exactly like this /s

Where do you think llms learned to write that way?

You can also look at past posts by the same author (before LLM usage proliferated) if you’re curious.

The project is still very cool, but it’s a little less enjoyable to read when everything sounds the same. It would be just as annoying for people to manually write in a corporate/marketing style, because humanity is what makes the small web interesting.

https://blog.tymscar.com/posts/privategithubcicd/

Re: I put a datacenter GPU in my gaming PC

#28

Post by lelanthran »

postalrat wrote: post #8
lelanthran wrote: post #3

> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Because humans write exactly like this /s

Where do you think llms learned to write that way?

> Where do you think llms learned to write that way?

Not from individual human content, that's for sure - maybe MLM marketing copy? Sleazy 4AM ads?

I mean, every time this response comes up, I keep asking the person to point at something written prior to 2022 that gets 80%+ on the LLM detectors, and yet no one can find anything.

Maybe you, postalrat, can find something written in this style that was published prior to 2022.

Re: I put a datacenter GPU in my gaming PC

#29

Post by peddling-brink »

m0rde wrote: post #24
recursivegirth wrote: post #19

> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Had to stop there. Annoying. I can't stand AI use for writing. It makes any otherwise great article feel so disingenuous.

What a difficult world you must live in these days

While I don’t disagree with their sentiment, I’m far more annoyed with it than the AI writing.

Re: I put a datacenter GPU in my gaming PC

#30

Post by m0rde »

peddling-brink wrote: post #29
m0rde wrote: post #24

Earlier quoted context omitted.

What a difficult world you must live in these days

While I don’t disagree with their sentiment, I’m far more annoyed with it than the AI writing.

Yeah. I get that many HN comments are just complaints (heck mine was too and just as negative and shaming). But how bad of a day must you be having to try to shame someone about how they choose to write up an experience they thought was neat. Whatever, free speech and all that. Hope OC's day gets better.
Post reply on HN