But could you game with the GPU? Or is that purely a drivers issue?
I assume you can game with it if you use modded drivers. At least with CMP 50HX that is possible
https://videocardz.com/newz/nvidia-cmp-50hx-turned-into-gami...
I put a datacenter GPU in my gaming PC
101–110 of 199 posts
Re: I put a datacenter GPU in my gaming PC
#102Great write-up, I've often considered these DC cards for a project and now you've convinced me to pick one up; you describe the price of the unit against what one spends on tokens and that does it for me.
Thats why I did it. I think it’s important to put things like that into perspective
Re: I put a datacenter GPU in my gaming PC
#103Could probably avoid the crazy fan with a waterblock - I've seen a whole kit, v100 + PCIE adapter + block for £235. Yes, you'll have to pay for pump, radiators and radiator fans, but that should really quieten it down
Someone's already made such a kit as you describe to fit in a consumer PC case and work properly?
Re: I put a datacenter GPU in my gaming PC
#104That's the same price per VRAM GB as an arc pro B70
But with miles better support, thats why I went this route. Cuda is hard to beat
Re: I put a datacenter GPU in my gaming PC
#105The real question: did your local LLM write this post?
There are many tells aren't there? There was clearly hard human work and experimentation here, but it's a shame the OP let AI do chunks of the writing. Once you see it, it's much harder to take the post seriously.
Not at all, no.
I had this chat before about how I am one of those unlucky few that loved the way LLMs write nowadays since the mid-2000s.
Slowly but surely, I had to remove my beloved lists, emojis (though LLMs do less of that now, maybe I can incorporate them back), and emdashes.
Re: I put a datacenter GPU in my gaming PC
#106Could probably avoid the crazy fan with a waterblock - I've seen a whole kit, v100 + PCIE adapter + block for £235. Yes, you'll have to pay for pump, radiators and radiator fans, but that should really quieten it down
Someone's already made such a kit as you describe to fit in a consumer PC case and work properly?
32 GB kit as well
https://www.ebay.co.uk/itm/406939344915?_trkparms=amclksrc%3...
Re: I put a datacenter GPU in my gaming PC
#107AI written posts will kill HN.
AI didnt edit a single word of this post.
Re: I put a datacenter GPU in my gaming PC
#108> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Had to stop there. Annoying. I can't stand AI use for writing. It makes any otherwise great article feel so disingenuous.
Agree. But I have not used AI in the slightest.
Some of us just write that. AIs had to learn it from somewhere.
Re: I put a datacenter GPU in my gaming PC
#109> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Had to stop there. Annoying. I can't stand AI use for writing. It makes any otherwise great article feel so disingenuous.
That line was the exact moment I also realized the post was AI written. I kept reading though, but I am left constantly guessing at which key details might be pure hallucinations.
FYI, not a single line was AI written. If there is a hallucination, it’s fully mushy brain sourced.
Re: I put a datacenter GPU in my gaming PC
#110Impressive work. But the problem is not the 30 tok/s which is fine for agentic coding and chat. It's prefill; slow prefill kills agentic workloads dead. If you have 100,000 tokens at ~150tok/s per the OP, you're looking at: You have: 100000 / (150/s) You want: hms 11 min + 6.6666667 sec Which is quite a wait indeed.
Most people won’t be dumping 100K tokens into it at once, but I agree that all of the prefill time that adds up during a session becomes a lot to account for. This is also a problem for all of the Mac local LLMs. Macs are a great way to get a lot of high bandwidth memory, but their compute is very far behind current gen dedicated GPUs. Some of the expensive Mac Studio setups allow you to run very large models with us…
When you're using OpenCode it's easy to reach 100,000 tokens after a while.