Live data from Hacker News

Long Live the 'GPU Poor' – Open-Source AI Grants

a16z.com

91–100 of 124 posts

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#91

"We believe artificial intelligence has the power to save the world" I don't agree with the side that says AI is about to destroy everything, it seems very hyperbolic... but neither do I agree with this sentiment that it's going to save the world.

Agree. It's not at all obvious the world is in need of saving.

That said, software of all kinds (including machine learning) does make the world more interesting and exciting, so happy to see more investment.

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#92

Earlier quoted context omitted.

I agree this initiative helps solve real pain points, and I'm not trying to defend "Crypto" with my question here but isn't solving a "real pain" kinda subjective? For example, many people/companies have the real pain/need to improve ad click-through-rates and reduce crypto/gas fees but maybe these aren't problems you care about.

Solving pain point == A problem we can profit from. Always has been. Plus A16Z has some questionable motives in general based on previous comments by them...

I guess sometimes a pain can exist without a profit, there's only a small number of people willing to solve those pains without a profit incentive though (pro bono lawyers, doctor's without borders, etc).

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#93
post #77
post #70

Earlier quoted context omitted.

8x4090 machines should be a lot cheaper than that. 1599*8=12,792. I.e. closer to 16x4090 machines. Sure labor is worth something but he has it in cash, and also there's barely a lot of people (yet) paying high prices for research (non ML ops) labor hours for this yet so the salary wouldn't be that high anyway. Just a pet peeve when ppl under exaggerate how many gpus/flops a dollar can buy (if you're slighly smart wit…

Meh, I was just ballparking. But add a threadripper, compatible motherboard, lots of RAM, fast storage, a few beast PSUs, and tax, and you're probably around 18k. So you ain't getting 2 of these machines for 25k. Plus you'll need to set aside some money for the power bill lol

Also possibly upgrading the wiring in your house or office.

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#94
post #75

Earlier quoted context omitted.

thank you!! Indeed, we have been interacting in space very closely and doing our best to keep up and contribute where possible

Is there a way we can apply? I am building https://atomictessellator.com , and since I am 100% technical I am not sure about commercialising or open sourcing it, I definitly would like to open source some of the components (e.g. turnkey dockerized scientific computing environments, the molecular force viewer, and also open up a hub for the environments and models) - when I was in Stanford meeting with some comp chemi…

feel free to DM on twitter or linkedin. In a nutshell, if you want to pursue a company now in or in the near future, we would likely need to consider you through our normal investing process for equity funding. If you are considering just working on it OSS, we would encourage taking first steps in that direct, and testing community-project fit validation before quite going full or near-full time!

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#95
post #70

Earlier quoted context omitted.

8x4090 machines should be a lot cheaper than that. 1599*8=12,792. I.e. closer to 16x4090 machines. Sure labor is worth something but he has it in cash, and also there's barely a lot of people (yet) paying high prices for research (non ML ops) labor hours for this yet so the salary wouldn't be that high anyway. Just a pet peeve when ppl under exaggerate how many gpus/flops a dollar can buy (if you're slighly smart wit…

What about PSU to power all of this, GPU motherboards, SSDs, CPU to not bottleneck this and sufficient RAM? You could argue it's more than 8, but definitely not 16. To utilize those GPUs to the max you need memory bandwidth to even feed it enough data.

Yeh I built a dual 3090 machine and just to have those 2 cards run well cost a lot for all the other stuff. Workstation spec mobo, top tier PSU, CPU and memory with headroom for the system, not to mention storage and case and cooling. And this is just a hobbyist build. Cost would have easily doubled if I actually got server grade CPU and memory etc.

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#96
post #64

I'm glad you guys are sharing some money around, but I really have a hard time thinking of a person with "Dual 4090s" as "GPU Poor". LOL

I interpret "GPU poor" the same way as "house poor", i.e. you're poor (lack cash) because you've use it to purchase GPUs, not that you don't have enough GPUs.

No, GPU poor comes from this definition: https://www.businessinsider.com/gpu-rich-vs-gpu-poor-tech-co...

Less than 10k H100s makes you GPU poor. The author is presumably using it as a proxy for "possible to achieve AGI".

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#97
post #58

Noob Q: If I have 25000$ can I buy some GPUs and support the effort for supporting GPU Poor? Like is there a DIYer's guide to do this? I don't want to donate the cash but instead set up a handful of GPUs(Somehow?) and let people pay at cost to use them.

honestly would recommend using spot/rented instances on that budget vs. buying! A100s run around ~$2/hour, the hard part is getting a large allocation... training workloads are quite spikey anyways, usually running lots of smaller experiments before actually doing a larger single run...

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#98

Congrats to the folks involved. Even knowing this is partly motivated by branding/marketing, it's great to see a16z getting more aligned with solving real pain points (vs crypto and churning out shallow media in recent years). Hope they can keep it up and hopefully more "thought leaders"/VCs follow suit. Best of luck.

I agree this initiative helps solve real pain points, and I'm not trying to defend "Crypto" with my question here but isn't solving a "real pain" kinda subjective? For example, many people/companies have the real pain/need to improve ad click-through-rates and reduce crypto/gas fees but maybe these aren't problems you care about.

Agreed, "real pain" is a subjective/vague term and even crypto is a broad term. My intended use here is to describe solutions that are more grounded/integrated into reality vs. more grounded in a fantasy of how the world works. It is hard to describe well though and if you keep unrolling most perceptions of reality are subjective

Re: Long Live the 'GPU Poor' – Open-Source AI Grants

#100
post #58

Noob Q: If I have 25000$ can I buy some GPUs and support the effort for supporting GPU Poor? Like is there a DIYer's guide to do this? I don't want to donate the cash but instead set up a handful of GPUs(Somehow?) and let people pay at cost to use them.

No intention to attribute malice, but wouldn't this be more like buying a condo and renting it out to pay your mortgage rather than donating resources?
Post reply on HN