Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

All You Need Is 4x 4090 GPUs to Train Your Own Model

sabareesh.com

Post reply on HN
Print view View original

121–125 of 125 posts

Re: All You Need Is 4x 4090 GPUs to Train Your Own Model

#121

Post by taskforcegemini »

manmal wrote: post #41
gzer0 wrote: post #30

This is a great build, thanks for sharing your learnings. The best build I have seen so far had 6x4090's. Video: https://www.youtube.com/watch?v=C548PLVwjHA Specifications - GPU Accelerator - 6 x 24GB NVIDIA GeForce RTX 4090 - Processor - Intel Xeon W7-3465X, 28C/56T, 2.5GHz - 4.8GHz - Memory - 256GB (8x32GB) DDR5 ECC 4800MHz - System Drive - 2TB Samsung 980 PRO NVMe PCIe 4.0 M.2 SSD - Storage Drive - 4TB Samsung 870…

On Reddit there's reports of 8x4090, or even 8xH100. I don't know where people get this kind of money for this, and why they don't rent infra instead.

I mean, at some point someone has to buy them to be able to offer services on them to others. Renting comes with certain limitations owners don't have. And some people have too much money to not invest in fun.

Re: All You Need Is 4x 4090 GPUs to Train Your Own Model

#122

Post by yieldcrv »

kristopolous wrote: post #117
lostmsu wrote: post #97

Earlier quoted context omitted.

If you are on Windows, take a look at https://borg.games/setup (founder here) We aim at $1200/y for 3090, so around a year given descent electricity prices. Highly recommend setting a lower power limit (usually 250W for 3090).

Btw, for other people reading this, the main player in the "rentable gamer gpu" space is salad.com who 6 months ago cut a deal with civitai ( https://blog.salad.com/civitai-salad/ ). They're trying to capture enterprise customers to use the extra cycles on teenager's gaming rigs. The industry is full of effectively "imitation companies" right now. For instance, runpod, quickpod, simplepod and clore are the ones cloni…

yo, I don’t care bro

I guess what I’m missing is, what’s scammy about them?

even in the web3 space, AI gpu compute markets are oversaturated

but why is an end user supposed to case about the user acquisition strategy?

if they’re cheaper, more profitable for the gpu owner, or solving a need better, that’s all that matters

Re: All You Need Is 4x 4090 GPUs to Train Your Own Model

#123

Post by kristopolous »

yieldcrv wrote: post #122
kristopolous wrote: post #117

Earlier quoted context omitted.

Btw, for other people reading this, the main player in the "rentable gamer gpu" space is salad.com who 6 months ago cut a deal with civitai ( https://blog.salad.com/civitai-salad/ ). They're trying to capture enterprise customers to use the extra cycles on teenager's gaming rigs. The industry is full of effectively "imitation companies" right now. For instance, runpod, quickpod, simplepod and clore are the ones cloni…

yo, I don’t care bro I guess what I’m missing is, what’s scammy about them? even in the web3 space, AI gpu compute markets are oversaturated but why is an end user supposed to case about the user acquisition strategy? if they’re cheaper, more profitable for the gpu owner, or solving a need better, that’s all that matters

> what’s scammy about them?

You can multi sell a machine, use qemu to lie about the hardware, have hidden fees... there's a bunch of hustle

> AI gpu compute markets are oversaturated

This is not the case. We see a moving average of over 90% utilization of our network. There's a lot of players, but the demand is outstripping supply

> why is an end user supposed to case about the user acquisition strategy?

Well hn is founder/insider talk but for a more direct answer, more legit institutions get higher retention and easier customers.

We're a two sided marketplace so we need to create a platform where people see integrity.

Re: All You Need Is 4x 4090 GPUs to Train Your Own Model

#125

Post by lostmsu »

kristopolous wrote: post #117
lostmsu wrote: post #97

Earlier quoted context omitted.

If you are on Windows, take a look at https://borg.games/setup (founder here) We aim at $1200/y for 3090, so around a year given descent electricity prices. Highly recommend setting a lower power limit (usually 250W for 3090).

Btw, for other people reading this, the main player in the "rentable gamer gpu" space is salad.com who 6 months ago cut a deal with civitai ( https://blog.salad.com/civitai-salad/ ). They're trying to capture enterprise customers to use the extra cycles on teenager's gaming rigs. The industry is full of effectively "imitation companies" right now. For instance, runpod, quickpod, simplepod and clore are the ones cloni…

Wow, I question the ethical side of this comment. It starts praising a company as if it were an unrelated entity, then quietly switches to "us", then makes implications about competing enterpreneural efforts being scams without any evidence. And "clones" (as if everyone knew about them - I didn't until about 1y into mine for instance).

There's also the hypocrisy of complaining about competitors jumping in on "their threads" in a comment on a competitor thread.

Yes, this comment of yours is highly unethical.

Post reply on HN