121–130 of 175 posts
Are there any training/ownership models like Folding@Home? People could donate idle GPU resources in exchange for access to the data, and perhaps ownership. Then instead of someone needing to pony up $85k to train a model, a thousand people can train a fraction of the model on their consumer GPU and pool the results, reap the collective rewards.
How long until somebody creates a crypto project on that?
Earlier quoted context omitted.
> I want the best LLMs to be open source too How do you do this without being incredibly wealthy?
You (1) are a company who (2) understands the business domain and has an appropriate business plan. Sadly the reality of funding today makes it unlikely that these two will both be simultaneously satisfied. The problem is that history will look back on the necessary business plan and deem it a failure even if it generates a company that does a billion dollars plus in annual revenue. This is actually not unique to lar…
Are there any training/ownership models like Folding@Home? People could donate idle GPU resources in exchange for access to the data, and perhaps ownership. Then instead of someone needing to pony up $85k to train a model, a thousand people can train a fraction of the model on their consumer GPU and pool the results, reap the collective rewards.
https://learning-at-home.github.io/
Earlier quoted context omitted.
The ones that can't use the GPT4 for whatever reason. Maybe you are a company and you don't want to send OpenAI your prompts. Or a person who has very private prompts and feel sketchy about sending them over. Or maybe you are an individual who has a use case that's too edgy for OpenAI or a silicon valley corporate image. When Replika shut down people trying to have virtual boyfriend/girlfriends on their platform, the…
Those are seriously niche use cases. They exist but can they fund gpt5 level development?
And companies would not want to do that. Imagine you make partner AI that goes unhinged like Bing did and tells you to kill yourself or something similar. I can't imagine companies would want that kind of risk.
Are there any training/ownership models like Folding@Home? People could donate idle GPU resources in exchange for access to the data, and perhaps ownership. Then instead of someone needing to pony up $85k to train a model, a thousand people can train a fraction of the model on their consumer GPU and pool the results, reap the collective rewards.
That’d be cool but I don’t think most idle consumer GPUs (6-8GB) would have large enough memory for a single iteration (batch size 1) of modern LLMs. But I’d love to see more federated/distributed learning platforms.
Earlier quoted context omitted.
Only for images. People want to generate videos next and those models will be likely GPT-sized.
There is a video model making the rounds on /r/stablediffusion and it is just a tiny bit larger than Stable Diffusion.
Can someone at the EU, the only player in this thing with no strategy yet just pool together enough resources so the open-source people can train models. We don't ask much, just give compute power
Feel free to form a multinational consortium and submit a grant application to one of our distribution partners under the Horizon program though.
Now, how do you plan to create jobs and reduce CO2?
Earlier quoted context omitted.
Those are seriously niche use cases. They exist but can they fund gpt5 level development?
Given the Replika debacle, I personally suspect the AI partner use case is not really very niche. Just few people openly want to talk about wanting it because having an emotional AI partner is seen as creepy. And companies would not want to do that. Imagine you make partner AI that goes unhinged like Bing did and tells you to kill yourself or something similar. I can't imagine companies would want that kind of risk.
Earlier quoted context omitted.
Those are seriously niche use cases. They exist but can they fund gpt5 level development?
Given the Replika debacle, I personally suspect the AI partner use case is not really very niche. Just few people openly want to talk about wanting it because having an emotional AI partner is seen as creepy. And companies would not want to do that. Imagine you make partner AI that goes unhinged like Bing did and tells you to kill yourself or something similar. I can't imagine companies would want that kind of risk.
Even Jennifer Lawrence stored her nudes on iCloud.