Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
1–8 of 8 posts
Re: Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
#2training the GPT-3 175B model required 3.2 million core hours spread across 285,000 processor cores over several months. It is projected that the overall cost of training the model will be roughly $4.6 million.
Re: Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
#3we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for.
Re: Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
#4training the GPT-3 175B model required 3.2 million core hours spread across 285,000 processor cores over several months. It is projected that the overall cost of training the model will be roughly $4.6 million.
We are doomed
Re: Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
#5we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for.
One day we will be kicked out of our Jobs
Re: Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
#6we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for.
As many have said before, there are open GPT models you can use. You can't run ChatGPT yourself, but you don't have the resources to run it anyways.
You can get relatively SOTA models running locally, it just requires a lot of compute.
Re: Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
#7we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for.
LAION is working on an open chatgpt like model [0] and there is a project discussed here recently that is about running the llms on single gpus [1]
I agree, there is a very serious risk of newer AI advances being closed by default, and I think it's not being taken seriously enough.
Even "open" players are still for-profit, say Huggingface. There really needs to be Linux or FSF like players that are motivated by freedom.
[0] https://github.com/LAION-AI/Open-Assistant [1] https://github.com/FMInference/FlexGen
Re: Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World
#8we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for.
As many have said before, there are open GPT models you can use. You can't run ChatGPT yourself, but you don't have the resources to run it anyways. You can get relatively SOTA models running locally, it just requires a lot of compute.
[deleted]