Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Long Live the 'GPU Poor' – Open-Source AI Grants

a16z.com

Post reply on HN
Print view View original

61–70 of 124 posts

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#61

Post by capableweb »

itissid wrote: post #58

Noob Q: If I have 25000$ can I buy some GPUs and support the effort for supporting GPU Poor? Like is there a DIYer's guide to do this? I don't want to donate the cash but instead set up a handful of GPUs(Somehow?) and let people pay at cost to use them.

vast.ai can help you offer this and has bunch of docs on how you can start hosting: https://vast.ai/docs/hosting/hosting

You won't be able to limit it to a particular set of clients who want to use it, but you're basically supporting the "GPU Poor" by doing this, as I think it's mostly smaller companies, individuals and researchers using vast.ai, rather than huge companies.

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#62

Post by bodecker »

skeeter2020 wrote: post #54
jacquesm wrote: post #51

Earlier quoted context omitted.

No, they're still saving the world, only now not through crypto but through AI... https://a16z.com/2023/06/06/ai-will-save-the-world/

this just seems like a cost-effective attempt to buy credibility and stay relevant, but I'm a crusty, old curmudgeon so what do I know.

Agreed, but IMO it's their job to do stuff like this (and prob unrealistic to expect a world where it doesn't exist). I'd rather see a higher percentage of marketing for things that have more real value vs. less

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#63

Post by redox99 »

itissid wrote: post #58

Noob Q: If I have 25000$ can I buy some GPUs and support the effort for supporting GPU Poor? Like is there a DIYer's guide to do this? I don't want to donate the cash but instead set up a handful of GPUs(Somehow?) and let people pay at cost to use them.

25K will either get you money for renting servers, or allow you to jerry rig yourself something like a 8x4090 machine.

The servers that most people would like to run (8xA100, 8xH100) are over 200k, and even if you had the money they're probably very hard to get right now.

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#64

Post by qntty »

Kon-Peki wrote: post #32

I'm glad you guys are sharing some money around, but I really have a hard time thinking of a person with "Dual 4090s" as "GPU Poor". LOL

I interpret "GPU poor" the same way as "house poor", i.e. you're poor (lack cash) because you've use it to purchase GPUs, not that you don't have enough GPUs.

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#67

Post by outside1234 »

naillo wrote: post #65

A16z is getting 'mad respect' from me for taking this line of the 'ai wars' and generally their attitude on all this. Really cool that they're going straight into 2010 era startup energy on this new wave. Idk I just find them really cool and inspirational.

If nothing else, it is good to see them moving off of the Bitcoin grift

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#70

Post by naillo »

redox99 wrote: post #63
itissid wrote: post #58

Noob Q: If I have 25000$ can I buy some GPUs and support the effort for supporting GPU Poor? Like is there a DIYer's guide to do this? I don't want to donate the cash but instead set up a handful of GPUs(Somehow?) and let people pay at cost to use them.

25K will either get you money for renting servers, or allow you to jerry rig yourself something like a 8x4090 machine. The servers that most people would like to run (8xA100, 8xH100) are over 200k, and even if you had the money they're probably very hard to get right now.

8x4090 machines should be a lot cheaper than that. 1599*8=12,792. I.e. closer to 16x4090 machines. Sure labor is worth something but he has it in cash, and also there's barely a lot of people (yet) paying high prices for research (non ML ops) labor hours for this yet so the salary wouldn't be that high anyway.

Just a pet peeve when ppl under exaggerate how many gpus/flops a dollar can buy (if you're slighly smart with your money).

Post reply on HN