Here is a Python package that can download transformer embeddings automatically
In general a lot of people download models from huggingface, I think that package automates that task.
Ask HN: Open-source ChatGPT alternatives?
11–20 of 64 posts
Re: Ask HN: Open-source ChatGPT alternatives?
#12I'm not very familiar with this space but would have thought "OpenAI" would be at least somewhat open-source. Is this just naming and not relevant to the product at all?
> Is this just naming and not relevant to the product at all?
They took funding as an open source non profit. Once they got the money they turned into a closed sourced for-profit censorship machine.
Re: Ask HN: Open-source ChatGPT alternatives?
#13You also have GPT J 6B and BLOOM but to be honest they are not like ChatGPT. https://huggingface.co/EleutherAI/gpt-j-6B https://huggingface.co/bigscience/bloom
Can you elaborate on how they are not like ChatGPT? I was looking into GPT-JT (built on top of GPT J you mentioned). If I spend the time to actually finetune and run inference with one of these models, am I likely going to be disappointed at the results?
It depends what you use it for. If it’s to classify text and you can fine tune it, it’s probably good enough.
For following instructions, ChatGPT is a lot better but GPT J did relatively well if given enough examples on simple tasks.
For a chatbot, it’s not really useable.
Re: Ask HN: Open-source ChatGPT alternatives?
#14You also have GPT J 6B and BLOOM but to be honest they are not like ChatGPT. https://huggingface.co/EleutherAI/gpt-j-6B https://huggingface.co/bigscience/bloom
Can you elaborate on how they are not like ChatGPT? I was looking into GPT-JT (built on top of GPT J you mentioned). If I spend the time to actually finetune and run inference with one of these models, am I likely going to be disappointed at the results?
Maybe? GPT-J is closer to the AI-Dungeon model of intelligence. It's able to fill in the blank after what you type, but it's hysterically bad at answering precise questions (to the point that I had to nerf it for fun to see how stupid the output could get).
It will handle basic natural language and context clues just fine. It's just not very fast, and the generations probably won't be as thorough as ChatGPT.
Re: Ask HN: Open-source ChatGPT alternatives?
#15Earlier quoted context omitted.
Can you elaborate on how they are not like ChatGPT? I was looking into GPT-JT (built on top of GPT J you mentioned). If I spend the time to actually finetune and run inference with one of these models, am I likely going to be disappointed at the results?
Maybe? GPT-J is closer to the AI-Dungeon model of intelligence. It's able to fill in the blank after what you type, but it's hysterically bad at answering precise questions (to the point that I had to nerf it for fun to see how stupid the output could get). It will handle basic natural language and context clues just fine. It's just not very fast, and the generations probably won't be as thorough as ChatGPT.
Am I going to be able to fine tune GPT-J or GPT-JT on consumer hardware?
Re: Ask HN: Open-source ChatGPT alternatives?
#16Here is a Python package that can download transformer embeddings automatically https://www.trychroma.com/ In general a lot of people download models from huggingface, I think that package automates that task.
I don't know if there is an implication here that I don't get, but I don't see the connection between this answer and the question I asked.
Re: Ask HN: Open-source ChatGPT alternatives?
#17Here is a Python package that can download transformer embeddings automatically https://www.trychroma.com/ In general a lot of people download models from huggingface, I think that package automates that task.
I don't know if there is an implication here that I don't get, but I don't see the connection between this answer and the question I asked.
You want a large language model. This gives you a large language model.
Re: Ask HN: Open-source ChatGPT alternatives?
#18Clue on conversation "history"-- "While ChatGPT is able to remember what the user has said earlier in the conversation, there is a limit to how much information it can retain. The model is able to reference up to approximately 3000 words (or 4000 tokens) from the current conversation - any information beyond that is not stored.
Please note that ChatGPT is not able to access past conversations to inform its responses."
https://help.openai.com/en/articles/6787051-does-chatgpt-rem...
Some interesting techniques I've seen involve essentially a ring-buffer and after each turn a call is made to summarize the conversation up to that point and use that as context for subsequent prompt
Re: Ask HN: Open-source ChatGPT alternatives?
#19Open Assistant (started by some of the people that started Stable Diffusion I think?) is very early, but looks very promising.
Re: Ask HN: Open-source ChatGPT alternatives?
#20[deleted]