If only crypto had started after gpt, then we would have had a clear goal of what to compute and how to incentivize the economics.
So is blockchain just an economic and architectural model to run crowdsourced things of value like GPT models? I mean it seems like a good first use case.
Ask HN: Can you crowdfund the compute for GPT?
91–100 of 157 posts
Re: Ask HN: Can you crowdfund the compute for GPT?
#92Earlier quoted context omitted.
https://arxiv.org/ has a ton of papers on it.
Do you have some good search terms to get started down the rabbit hole?
Re: Ask HN: Can you crowdfund the compute for GPT?
#93Re: Ask HN: Can you crowdfund the compute for GPT?
#94https://docs.google.com/document/d/1NTsnUVRzBfK6y7WNX2JURogD...
Re: Ask HN: Can you crowdfund the compute for GPT?
#95I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…
I'm not sure whether or not they will be successful.
Re: Ask HN: Can you crowdfund the compute for GPT?
#96I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…
https://docs.google.com/document/d/1NTsnUVRzBfK6y7WNX2JURogD...
Re: Ask HN: Can you crowdfund the compute for GPT?
#97I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…
Re: Ask HN: Can you crowdfund the compute for GPT?
#98Earlier quoted context omitted.
https://arxiv.org/ has a ton of papers on it.
Do you have some good search terms to get started down the rabbit hole?
Re: Ask HN: Can you crowdfund the compute for GPT?
#99Their planning documents contain pages upon pages on all the related challenges, such as generating and storing the dataset, keeping your cluster running, tolerating node failures. In short: The compute time alone won't help you succeed.
Re: Ask HN: Can you crowdfund the compute for GPT?
#100I've often wondered why a service doesn't exist that allows you to rent out your graphics card for the large data processing needed for training models. Like mining bitcoin except you are doing something actually useful and getting paid actual money for it. Example: - Company Alpha needs $40,000,000 worth of cloud computing for their training model - Company Beta provides them said cloud computing for $30,000,000 fro…
But the issue with large language models is that you need ms-latency access to TBs of data, or else you won't be able to saturate your GPUs with useful work.