Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Open-source ChatGPT alternatives?

news.ycombinator.com

Post reply on HN
Print view View original

41–50 of 64 posts

Re: Ask HN: Open-source ChatGPT alternatives?

#41

Post by baobabKoodaa »

simonw wrote: post #40
baobabKoodaa wrote: post #35

Earlier quoted context omitted.

> When you say "fine tune" here what are you looking to do? As an example of fine tuning, I might take a pretrained model and then continue training it with a custom dataset that is tailored to a specific text generation task (not classification). Here is an example of a custom dataset that I might fine tune on: https://github.com/baobabKoodaa/future/blob/8d2ae91e6a6f00c7... I would like the LLM to generate fictional…

I've not yet managed to convince myself if fine tuning LLMs works for that kind of example. Have you tried fine tuning GPT3 via the OpenAI APIs for this? It should only cost a few dollars for that smaller set of examples, and it would at least help demonstrate it it's possible to get the results you want with the current best-in-class language model before you try to run that against a smaller model that you can fit…

> Have you tried fine tuning GPT3 via the OpenAI APIs for this

I haven't. That's not a bad idea.

> it would at least help demonstrate it it's possible to get the results you want with the current best-in-class language model before you try to run that against a smaller model that you can fit on your own hardware

The dataset you saw was (mostly) generated with ChatGPT and davinci-002, by using prompt engineering instead of fine tuning. So it's definitely possible to produce good results like this (though no judgment here on the question of prompt engineering vs fine tuning).

Re: Ask HN: Open-source ChatGPT alternatives?

#42

Post by simonw »

baobabKoodaa wrote: post #35
simonw wrote: post #32

Earlier quoted context omitted.

When you say "fine tune" here what are you looking to do? The impression I've got is that fine tuning large language models is mostly useful for very simple tasks, such as training a spam or categorization filter. If you're looking to take a model and then e.g. train it on a few thousand additional pages of documentation in order to get it to answer project-specific questions, I've got the impression that fine tuning…

> When you say "fine tune" here what are you looking to do? As an example of fine tuning, I might take a pretrained model and then continue training it with a custom dataset that is tailored to a specific text generation task (not classification). Here is an example of a custom dataset that I might fine tune on: https://github.com/baobabKoodaa/future/blob/8d2ae91e6a6f00c7... I would like the LLM to generate fictional…

Wow, this is really fun: I pasted your prompt from https://raw.githubusercontent.com/baobabKoodaa/future/8d2ae9... into ChatGPT and now it's acting exactly like I'm stuck in a weird future.

Re: Ask HN: Open-source ChatGPT alternatives?

#45

Post by rvz »

dieselgate wrote: post #10

I'm not very familiar with this space but would have thought "OpenAI" would be at least somewhat open-source. Is this just naming and not relevant to the product at all?

Initially they released papers and open-sourced the model and training set.

Then the VC money came in and they became ClosedAI and a for-profit and releases papers without the model. No better than what DeepMind already does.

The name ‘OpenAI’ now has no meaning. It is a deception and is essentially a Microsoft AI division.

Re: Ask HN: Open-source ChatGPT alternatives?

#46

Post by astrange »

gerash wrote: post #28
dieselgate wrote: post #10

I'm not very familiar with this space but would have thought "OpenAI" would be at least somewhat open-source. Is this just naming and not relevant to the product at all?

OpenAI stopped being a non-profit and hasn't published anything on Chatgpt yet

They have, although not datasets:

https://openai.com/blog/deep-reinforcement-learning-from-hum...

https://openai.com/blog/fine-tuning-gpt-2/

https://openai.com/blog/chatgpt/

People like Anthropic have been able to reproduce it.

Re: Ask HN: Open-source ChatGPT alternatives?

#47

Post by baobabKoodaa »

simonw wrote: post #42
baobabKoodaa wrote: post #35

Earlier quoted context omitted.

> When you say "fine tune" here what are you looking to do? As an example of fine tuning, I might take a pretrained model and then continue training it with a custom dataset that is tailored to a specific text generation task (not classification). Here is an example of a custom dataset that I might fine tune on: https://github.com/baobabKoodaa/future/blob/8d2ae91e6a6f00c7... I would like the LLM to generate fictional…

Wow, this is really fun: I pasted your prompt from https://raw.githubusercontent.com/baobabKoodaa/future/8d2ae9... into ChatGPT and now it's acting exactly like I'm stuck in a weird future.

Glad to hear you like it! I should probably note that the way I used it was by appending a few selected examples to the prompt. Having some examples improves the quality a lot. (I'm on mobile now so can't easily link but you can find the prompt examples starting from server.js)

Re: Ask HN: Open-source ChatGPT alternatives?

#48

Post by rvz »

We seriously need more mature and open-source LLMs that are as good as, if not better than ChatGPT. It was a great surprise to see Stable Diffusion disrupt DALLE-2 with open source

We need the same for ChatGPT and GPT-4.

Re: Ask HN: Open-source ChatGPT alternatives?

#49

Post by junipertea »

baobabKoodaa wrote: post #39
Mizza wrote: post #37

Earlier quoted context omitted.

Hold your damn horses, this technology is brand new, requires a tremendous amount of data gathering and computation, there's a massive volunteer effort already under way, and you're begging for a free home version so you can save $0.02 cents. You want a hole, pick up a shovel.

> Hold your damn horses, this technology is brand new, requires a tremendous amount of data gathering and computation, there's a massive volunteer effort already under way, and you're begging for a free home version so you can save $0.02 cents. You want a hole, pick up a shovel. $0.02 cents per API request. What I would like to do is provide people a free service on the internet that using an LLM under the hood. If y…

Even openAI with the massive success and popularity gain can not sustain keeping it for free. The 0.02$ cents is a bargain for the value provided.

OPs point was most of us can't burn 10k on a internet hobby project, and it costs probably 10x-100x more to train. How would you expect to provide people a free service? People are training it to open source right now, so please be patient.

Re: Ask HN: Open-source ChatGPT alternatives?

#50

Post by [deleted] »

junipertea wrote: post #49
baobabKoodaa wrote: post #39

Earlier quoted context omitted.

> Hold your damn horses, this technology is brand new, requires a tremendous amount of data gathering and computation, there's a massive volunteer effort already under way, and you're begging for a free home version so you can save $0.02 cents. You want a hole, pick up a shovel. $0.02 cents per API request. What I would like to do is provide people a free service on the internet that using an LLM under the hood. If y…

Even openAI with the massive success and popularity gain can not sustain keeping it for free. The 0.02$ cents is a bargain for the value provided. OPs point was most of us can't burn 10k on a internet hobby project, and it costs probably 10x-100x more to train. How would you expect to provide people a free service? People are training it to open source right now, so please be patient.

[deleted]
Post reply on HN