Live data from Hacker News

I put a datacenter GPU in my gaming PC

blog.tymscar.com

81–90 of 199 posts

Re: I put a datacenter GPU in my gaming PC

#81

Tesla V100 SXM2 16GB is NOT DGX class as the author writes. It's HGX class. The V100 comes in two classes, SXM2 and SXM4, the latter coming with a Max of 80gb on board memory. Typically these are installed 8×A100 80GB SXM4 on an HGX riser, and what that gives you is NVSwitch fabric and 640GB of pooled HBM2e (on package stacked memory /w ~2 TB/s of memory bandwidth). 2u standard rack footprint too.

I have no idea what you are trying to say.

V100 came as sxm2 and sxm3. And it was 16 and 32gb.

HGX is DGX with extra toppings.

Re: I put a datacenter GPU in my gaming PC

#82
post #46

Could probably avoid the crazy fan with a waterblock - I've seen a whole kit, v100 + PCIE adapter + block for £235. Yes, you'll have to pay for pump, radiators and radiator fans, but that should really quieten it down

Someone's already made such a kit as you describe to fit in a consumer PC case and work properly?

[deleted]

Re: I put a datacenter GPU in my gaming PC

#83
post #58
post #39

> And yes, if you want the absolute best, Opus 4.8 exists. It also costs more per 20 minutes of heavy use than I paid for this entire GPU and adapter setup combined. But the gap is shockingly small. I don't think this is a fair characterization of the situation. I use frontier models via API pre-paid tokens every single day, and I can barely rack up $100 per month . The fact that we figured out how to burn double thi…

I use hosted providers myself, but I can churn through $100 worth of tokens in half a day even with cheap models like Deepseek easily. If someone's use is as light as yours, then sure - grab a subscription and you'll save far more. For higher use it will come down to how cheap your electricity is whether it is worth offloading at least some of it (for me it's not, FWIW)

Could you share a bit about what you’re working on or what type of projects require that much usage? Is it hobby, production, revenue generating?

Re: I put a datacenter GPU in my gaming PC

#84

Earlier quoted context omitted.

I disagree. Not everyone has a good writing style. In those instances I think it is fair to default to llm recommendation. We may be allergic to it, but we saw one formulaic response too many ( though admittedly it does raise a question of whether HN was the intended audience for it ). In any event, not all of us have a unique writing style worth preserving just like not all of us can write clear and clean code. Just…

I really wish it was more common to use AI for augmenting than authoring. Eg i find coding with LLMs neat when you primarily "talk" to it through code, by filling out structs, funcs, fields, etc - where it would use your changes as the template and then to work to effectively autocomplete the gaps. The more you iteratively write the less it fills in, but also the less it deviates from your intent, design, etc. I feel…

In a sense, there is a clear market for it ( people want 'authentic' experience ). I can kinda understand it. I want pure linux experience without systemd, but I recognize that in the current ecosystem, it comes at a cost.

So the language harness makes sense to me, but corps are already cracking down on token use ( and such a harness would likely only add to the cost ). The other question is whether the people, who could benefit it would even recognize it as a problem though.

Re: I put a datacenter GPU in my gaming PC

#85
post #34

> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Had to stop there. Annoying. I can't stand AI use for writing. It makes any otherwise great article feel so disingenuous.

That line was the exact moment I also realized the post was AI written. I kept reading though, but I am left constantly guessing at which key details might be pure hallucinations.

Honestly, the default styles are pretty bad. I use Claude in my scientific writing in a very specific way. 1. I write a paragraph. 2. I put Claude into concise style mode. I then ask Claude to revise for clarity.

I can write competently, but it's natural direction is towards emotional rhythmic flow that can convey emotion/passion...but which for scientific writing, can get in the way of clear clean communication. So, I write what I mean,and Claude straightens it out...and these days (i.e. not last year), it doesn't lose my meaning that often. And since I wrote it first, these AI-isms appear less frequently, and if they do, I revise them away.

Re: I put a datacenter GPU in my gaming PC

#86
post #48

Earlier quoted context omitted.

Things like this have started to show up on eBay: https://www.ebay.com/itm/198383386991 2X NVIDIA Tesla V100 32GB NVLink Water Cooled X99 E5-2686v4 AI Workstation PC Item Quantity Intel Xeon E5-2686 v4 CPU 1 2U CPU Cooler 1 Jingyue X99 Motherboard 1 DDR3 Memory 32GB SSD 480GB AMD Radeon R5 240 4K Display Card 1 NVIDIA Tesla V100 32GB SXM2 GPU 2 NVLink SXM2 Dual-GPU Baseboard 1 Corsair Water Cooling System 2 850W Bron…

terrible deal

Yeah. Not linking as an endorsement -- I do think it's cool, but it's not worth it for that price.

Re: I put a datacenter GPU in my gaming PC

#87
post #56

Earlier quoted context omitted.

There are many tells aren't there? There was clearly hard human work and experimentation here, but it's a shame the OP let AI do chunks of the writing. Once you see it, it's much harder to take the post seriously.

I disagree. Not everyone has a good writing style. In those instances I think it is fair to default to llm recommendation. We may be allergic to it, but we saw one formulaic response too many ( though admittedly it does raise a question of whether HN was the intended audience for it ). In any event, not all of us have a unique writing style worth preserving just like not all of us can write clear and clean code. Just…

It’s not about preserving a unique writing style. When I see LLM writing my brain automatically discards the content of the writing. To me, seeing LLM writing is equivalent to going to a high-end restaurant and getting served on generic paper plates. Sure, the food looks perfectly fine and there is, in theory, nothing wrong with a paper plate. Once you see that paper plate, however, you will question how nice that establishment actually is, because a lack of care for the plates undermines the quality of the food. You automatically categorize all establishments that serve on paper plates in a specific category, one that might make you concerned if you will get food poisoning that night. LLM writing is exactly the same way for me. I don’t know if this LLM-assisted piece of text is actually a Michelin three star establishment or has had several heath violations in the last year. However, I didn’t pay for it, so putting in effort to determine if it’s LLM-assisted writing from an expert or just LLM slop that isn’t from the purported author at all isn’t worth the time.

I’m much more willing to read typos and bad writing than LLM writing. If I want to read the LLM rewritten version, I can run an LLM over the original writing myself. I have not yet found true that anyone is better at prompting than anyone else in a way that suggests that I wouldn’t get substantially the same results myself. Thus, I don’t think providing the version that has passed through the telephone game is accomplishing something that couldn’t be done by readers later. I have spent the vast majority of my life reading the original writing styles of people and didn’t have an issue then. I’m not convinced a problem I had was solved when we started post-processing writing with an LLM.

Re: I put a datacenter GPU in my gaming PC

#88
I was just looking into this and was worried about the fan setup. Interesting that he was able to solve it with good results.

In case anyone is interested, I’m using PCIE passthrough on a FreeBSD host to a Linux guest with an older Pascal card. It’s worked great and I’ve been thinking about putting a nicer card in there. The SXM route seems great, but I’ve been burned (almost literally because of the heat) by DC components before.

Re: I put a datacenter GPU in my gaming PC

#89
post #65

Earlier quoted context omitted.

Claude is something like $35 per million tokens. If I was using API pricing I could trivially spend $100 in a single hour long coding session, with /fast turned on in about 10 minutes. Not sure how you guys are using it.

Opus is normally $5 per mtok, no idea why anyone would use /fast if they were at all concerned about price. ($5 is still pricy though tbh)

Opus is $5 per mtok of input tokens, but $25 for output.

Re: I put a datacenter GPU in my gaming PC

#90
post #30

Earlier quoted context omitted.

While I don’t disagree with their sentiment, I’m far more annoyed with it than the AI writing.

Yeah. I get that many HN comments are just complaints (heck mine was too and just as negative and shaming). But how bad of a day must you be having to try to shame someone about how they choose to write up an experience they thought was neat. Whatever, free speech and all that. Hope OC's day gets better.

It doesn’t read like shaming to me. It’s, in the grand scheme of HN comments, definitely on the more constructive side of the criticism. Maybe it could have been reworded, but I think the author of the post could very easily find it actionable in the future. I too had to stop reading the article at that point, so I think if the author wants more people to read, my advice for them is to just write like themselves. We’ve entered the start of a new Instagram filter age where many people feel they need to have LLMs reword their writing presumably for the same reasons as the original filter age. I share OC’s sentiment of pushing against the recent trend of implicitly shaming people for their individualistic writing styles.
Post reply on HN