Earlier quoted context omitted.
That’s a lot of blurays…
I found them dumped out in the “street” in a place ordained by law as public domain. So I just grabbed up the media and use it in private.
How many Blurays are we talking about?
Was my $48K GPU server worth it?
151–160 of 480 posts
Re: Was my $48K GPU server worth it?
#152Earlier quoted context omitted.
the very last line of the article: "If I were to do this again, I wouldn’t do a custom build like this. I would buy a standard datacenter server and rent space in a colocation center. But then I would miss saying Hi to grumbl once in a while."
Yes, i mean, he could rent a cage and run grumbl it there. It doesn't have to be a standard datacenter server, even though a standard datacenter server would be better and cheaper.
A cage[0] is ~100x larger than what you need to host a single server. Many data centers will colocate by the rack unit. At others you can get a quarter or half cabinet[1]. Even at the very largest enterprise datacenters you can colocate a single cabinet.
[0]: https://static.cisco-eagle.com/images/category/WireCrafters/...
[1]: https://www.edpeurope.com/wp-content/uploads/EDP-3-Compartme...
Re: Was my $48K GPU server worth it?
#153Earlier quoted context omitted.
Who is going to buy a $4299 M5 Max MBP with 64GB of RAM just to run Gemma 4 31b? Firstly you don't need 64GB for that model. Secondly if you want a machine that sits in the corner and does nothing but LLM inference, you don't buy a MacBook Pro, you buy some GPUs which are going to cost you a fraction of that (~$1k for ~64GB of VRAM is possible). The people buying Apple Silicon for inference general aim for the Mac St…
> Gemma 4 31b? Firstly you don't need 64GB for that model. You don't? It for sure doesn't run on my 32 GB M2 MAX.
What quant? You should have no problem running it at Q4 with 256K context, Q5 or Q6 even although maybe not at full context. I can run Q4 on a 4090 with just 24GB VRAM.
Re: Was my $48K GPU server worth it?
#154I have four old 24gb Nvidia cards. They're not great but they're not useless either. The problem is that I haven't really figured out a good way to actually use them. Genuine question; would anyone here recommend any specific motherboard to best utilize these cards?
You could ask AI and get pretty far reading the answer.
I know. But this is a forum filled with technical professionals and I would like to get actual opinions from actual humans.
AI is cool but it's not going to have all the good and bad experiences that humans have had with different motherboards.
Re: Was my $48K GPU server worth it?
#155Earlier quoted context omitted.
25k is definitely a lot but I did the risk analysis and I figured worst case I would lose a 1000-2000 after a year of playing around with it, so I look at it more like renting (I'm going to keep the Macbook Pro no matter what since I needed a new one).
Was this risk analysis just AI slop?
[deleted]
Re: Was my $48K GPU server worth it?
#156He didn't consider the possibility of renting it out during the downtime to Vast.ai to make some money back.
Re: Was my $48K GPU server worth it?
#157Earlier quoted context omitted.
Also a lightning strike or surge from the electric utility could fry the whole rig. Proper protection costs thousands, and even then it's not guaranteed to protect everything
> Proper protection costs thousands Frankly that's something a landlord should provide. And there's insurance against losses from electrical issues.
Why should a domestic landlord provide you with data center-level power protection instead of just the normal household utility connection?
Re: Was my $48K GPU server worth it?
#158Earlier quoted context omitted.
Nitpicking, but the worst case of spending $25k is unforeseen circumstances that write off the entire asset. I don’t think -$2000 is a conservative enough figure for standard depreciation either (a lot can happen in a year)
Either I don't understand the used apple market.. or I agree this is crazy. Someone spends $25k on new hardware, waits a year, and expects to sell it for $23k? Unless the ram issues save him, and cost of new goes up, I don't see how that was going to work.
Well, Apple is literally not offering the M3 512GB studios currently. You can’t even back order one.
They are selling on EBay for over $20k, used.
Re: Was my $48K GPU server worth it?
#159Earlier quoted context omitted.
Nitpicking, but the worst case of spending $25k is unforeseen circumstances that write off the entire asset. I don’t think -$2000 is a conservative enough figure for standard depreciation either (a lot can happen in a year)
Either I don't understand the used apple market.. or I agree this is crazy. Someone spends $25k on new hardware, waits a year, and expects to sell it for $23k? Unless the ram issues save him, and cost of new goes up, I don't see how that was going to work.
You could almost sell a RTX 3090 for more today than what it cost brand new when it came out six years ago
Re: Was my $48K GPU server worth it?
#160Earlier quoted context omitted.
Shallow take: They made an LLM that uses fewer emdashes. Cynical take: They made an LLM that can bypass existing AI slop detectors. Realistic take: They found a research problem they found interesting, dumped a bunch of capital and sweat equity into and (claimed to have, at least) found a solution. Neat!
You were on the money with the Cynical take lol: https://rosmine.ai/2026/05/18/fixing-llm-writing-with-distri...
Huh? That's them intentionally demonstrating the slop style.