[flagged]
Facebook also has OPT, which is one of the largest public pre-trained models
Ask HN: Open-source ChatGPT alternatives?
21–30 of 64 posts
Re: Ask HN: Open-source ChatGPT alternatives?
#22[flagged]
Did you generate this with Bing? I don't believe this answer is human-written. It describes 2 separate projects with the words "It is available on GitHub and can be used in various research projects".
according to gptzero AI detection it: ".. text may include parts written by AI"
Re: Ask HN: Open-source ChatGPT alternatives?
#23I'm not very familiar with this space but would have thought "OpenAI" would be at least somewhat open-source. Is this just naming and not relevant to the product at all?
> Is this just naming and not relevant to the product at all? They took funding as an open source non profit. Once they got the money they turned into a closed sourced for-profit censorship machine.
Yeah, but to be fair GPT 2 is open source and Whisper (a high-quality speech recognition and multilingual translation model) is also open source. A few years ago I needed a good model for transcription for a project and I couldn’t find anything decent. They really have contributed to the open source community.
If they keep releasing older models and keep their cutting-edge technology for profit I’m fine with it.
Re: Ask HN: Open-source ChatGPT alternatives?
#24Earlier quoted context omitted.
I don't know if there is an implication here that I don't get, but I don't see the connection between this answer and the question I asked.
You want a large language model. This gives you a large language model.
I asked for recommendations on which LLM would run on consumer hardware for the purposes of fine tuning and inference, with good results. You linked a package that can be used to download models? I don't see how these things are related.
Re: Ask HN: Open-source ChatGPT alternatives?
#25Open Assistant (started by some of the people that started Stable Diffusion I think?) is very early, but looks very promising. https://open-assistant.io/ https://github.com/LAION-AI/Open-Assistant
I briefly looked at this and it doesn't seem like they provide a model that I can fine tune on consumer hardware?
Re: Ask HN: Open-source ChatGPT alternatives?
#26In terms of models which are reasonably fast to run and easy to install, I think Flan-T5 is one of the best: https://huggingface.co/google/flan-t5-xxl - although out of the box it's more focused on giving short answers and it's very far from ChatGPT.
Re: Ask HN: Open-source ChatGPT alternatives?
#27Previous related discussions: https://news.ycombinator.com/item?id=34115698 https://news.ycombinator.com/item?id=33955125 https://news.ycombinator.com/item?id=34163413 https://news.ycombinator.com/item?id=34628256 https://news.ycombinator.com/item?id=34147281 https://news.ycombinator.com/item?id=34445873
I went through all of these and the only one in there that I found that might be fine-tuneable on consumer hardware seems to be KoboldAI. Not sure yet.
Re: Ask HN: Open-source ChatGPT alternatives?
#28I'm not very familiar with this space but would have thought "OpenAI" would be at least somewhat open-source. Is this just naming and not relevant to the product at all?
OpenAI stopped being a non-profit and hasn't published anything on Chatgpt yet
Re: Ask HN: Open-source ChatGPT alternatives?
#29Earlier quoted context omitted.
Maybe? GPT-J is closer to the AI-Dungeon model of intelligence. It's able to fill in the blank after what you type, but it's hysterically bad at answering precise questions (to the point that I had to nerf it for fun to see how stupid the output could get). It will handle basic natural language and context clues just fine. It's just not very fast, and the generations probably won't be as thorough as ChatGPT.
Am I going to be able to fine tune GPT-J or GPT-JT on consumer hardware?
[deleted]
Re: Ask HN: Open-source ChatGPT alternatives?
#30In terms of models which are reasonably fast to run and easy to install, I think Flan-T5 is one of the best: https://huggingface.co/google/flan-t5-xxl - although out of the box it's more focused on giving short answers and it's very far from ChatGPT.
It's not clear from the link if it's possible to fine tune Flan-T5 on consumer hardware?