Live data from Hacker News

Ask HN: Can you crowdfund the compute for GPT?

news.ycombinator.com

91–100 of 157 posts

Re: Ask HN: Can you crowdfund the compute for GPT?

#91
post #43

If only crypto had started after gpt, then we would have had a clear goal of what to compute and how to incentivize the economics.

So is blockchain just an economic and architectural model to run crowdsourced things of value like GPT models? I mean it seems like a good first use case.

They usually aren’t calculating anything interesting, but in principal there could be something like that made.

Re: Ask HN: Can you crowdfund the compute for GPT?

#92

Earlier quoted context omitted.

https://arxiv.org/ has a ton of papers on it.

Do you have some good search terms to get started down the rabbit hole?

I too would like to go down this rabbit hole. I am going to poke around using the terms “distributed learning” and “federated learning” (They’re different areas, but somewhat related as far as I understand).

Re: Ask HN: Can you crowdfund the compute for GPT?

#95
post #25

I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…

There a few crypto projects that aim to do this, this one is focused on artists

https://rendertoken.com

I'm not sure whether or not they will be successful.

Re: Ask HN: Can you crowdfund the compute for GPT?

#96
post #25

I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…

Here's a whitepaper for a project called AI Compute Token:

https://docs.google.com/document/d/1NTsnUVRzBfK6y7WNX2JURogD...

Re: Ask HN: Can you crowdfund the compute for GPT?

#97
post #25

I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…

When Playstation 3 came out there was an app that shipped by default where you could leave it running and it would use your CPU for protein folding calculations to help researchers figure out the structure of proteins.

Re: Ask HN: Can you crowdfund the compute for GPT?

#98

Earlier quoted context omitted.

https://arxiv.org/ has a ton of papers on it.

Do you have some good search terms to get started down the rabbit hole?

This one is a few years old, but seems interesting: https://arxiv.org/abs/1802.05799v2

Re: Ask HN: Can you crowdfund the compute for GPT?

#99
You might be interested in the LEAM.AI initiative, which is basically the EU planning to fund the creation of an Open Source GPT-3 competitor.

Their planning documents contain pages upon pages on all the related challenges, such as generating and storing the dataset, keeping your cluster running, tolerating node failures. In short: The compute time alone won't help you succeed.

Re: Ask HN: Can you crowdfund the compute for GPT?

#100
post #25

I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…

You can rent out your GPU to vast.ai

But the issue with large language models is that you need ms-latency access to TBs of data, or else you won't be able to saturate your GPUs with useful work.

Post reply on HN