I would love to switch to something like this over OpenAI's GPT3.5 Turbo, but this weekend I'm struggling to get reasonable inference speed on reasonably priced machines.
OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
31–40 of 64 posts
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#32This makes Turbo GPT 3.5 level AI free, private and finetuneable. OpenAI exclusivity shrinks now to GPT-4. That's why I don't think they will be able to keep a large market share in LLMs, any level of AI is going to get open and free soon. SOTA models are also easy to distill by API, very hard to defend against using chat logs as training data for other models. Once we all got one running, maybe in the OS, maybe in t…
The problem is that for-profit businesses like OpenAI have more money and compute than even millions of volunteers. I definitely believe we'll get an open GPT-4 eventually, but by then OpenAI will have GPT-5, and so on. It's a shame really: the ultimate cause is the massive amount of wealth inequality we have today. If private entities and governments didn't have so much resources compared to individuals, I'm certain…
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#33This makes Turbo GPT 3.5 level AI free, private and finetuneable. OpenAI exclusivity shrinks now to GPT-4. That's why I don't think they will be able to keep a large market share in LLMs, any level of AI is going to get open and free soon. SOTA models are also easy to distill by API, very hard to defend against using chat logs as training data for other models. Once we all got one running, maybe in the OS, maybe in t…
I can't wait for an ad companies to force you to watch a 10 second video ad before it gives you a result for your query. It's only a matter of time before these AI companies start pairing up with ad companies(if they already haven't). Google could easily put ad videos every 10 queries or something. You already see these limited free tokens/credits/querie on AI art sites. How long until they put some ads in-between qu…
Prompt: What are the 3 most populated EU countries?
Response: The three European countries with the highest populations are Germany, France and Italy. You can book a flight to any of these locations now for 10% off on Expedia.com. Use code TravelGPT.
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#34Earlier quoted context omitted.
The problem is that for-profit businesses like OpenAI have more money and compute than even millions of volunteers. I definitely believe we'll get an open GPT-4 eventually, but by then OpenAI will have GPT-5, and so on. It's a shame really: the ultimate cause is the massive amount of wealth inequality we have today. If private entities and governments didn't have so much resources compared to individuals, I'm certain…
Won't open-source AIs have their code stolen by the private AIs? There's no one stopping open-source AIs being used within private AIs.
Even if the private AI owner made some unique discovery which gives them an advantage, its very likely to only be unique for a short while (see: some of the world’s major discoveries simultaneously found by different people. I’m sure there would be more if not for word-of-mouth)
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#35To the naysayers that point out that OpenAssistant is not as good as ChatGPT: all of LLM development is still in the early days; the work being done by teams like OA is helping to shape the future development of the entire field by creating an actually-open-source foundation. The results of this work will only get better with time.
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#36Earlier quoted context omitted.
What beautiful garden? Are you completely ignoring the fact that OpenAI is made possible because it scraped the entire Web (the actual garden) and made a query index out of it? Do you not have any respect for people who actually spent their time and creativity to provide the information necessary for this model to even work? Ignorance is bliss I guess.
Out of curiosity, do you use ad blocking software?
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#37What is the token limit? The 2k limit on llama is *very limiting on the number of things it can do.
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#38Earlier quoted context omitted.
The problem is that for-profit businesses like OpenAI have more money and compute than even millions of volunteers. I definitely believe we'll get an open GPT-4 eventually, but by then OpenAI will have GPT-5, and so on. It's a shame really: the ultimate cause is the massive amount of wealth inequality we have today. If private entities and governments didn't have so much resources compared to individuals, I'm certain…
Although FOSS is great, extreme wealth inequality has to be fixed by the government and not by open source developers.
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#39With more RIFL it will only get better. Nice progress!!
Re: OpenAssistant Conversations – Democratizing Large Language Model Alignment [pdf]
#40It's awesome that the OpenAssistant project made it this far with a lot of crowed-sourced input. Congrats to the whole team that works really hard trying to create a truly open LLM. One thing that puzzles me though, is that for the GPT-3.5 comparison, the model used is trained using both OpenAssistant and alpaca data, which is not free due to the OpenAI license used to generate the data. Isn't that defeating the purp…
What makes you think OpenAI responses are copyrighted in any way?