31–40 of 126 posts
Can someone explain why I'd want to use fine-tuning instead of a vector database (or some other way of storing data/context)?
I think it probably works a lot better, but I would love to see some research validating this
Can someone explain why I'd want to use fine-tuning instead of a vector database (or some other way of storing data/context)?
I've been playing with using documents as OpenAI embeddings for the past weeks and, at least for my use case, the results are meh. It seems sometimes just using context is not enough. My next step is to play with fine tunning, but I have no results to report yet.
Have a question to the Generative AI experts here. So, I can use smthg like GPT-4 to label data and then use that as a train set for my own LLM, right? EDIT: adding this from OpenAI Restriction TOS: "(iii) use output from the Services to develop models that compete with OpenAI;"
It is my understanding that this is how “alignment” works. That is, openAI paid people to chat with their LLM to fine tune it and then other LLMs use chatgpt to generate training data to align their models.
1. make your own RLHF dataset - like OpenAI and Open Assistant
2. exfiltrate data from a bigger/better LLM - Vicuna & family
3. use your pre-trained LLM to generate RLAIF data, no leeching - ConstitutionalAI, based on a set of rules instead of labelling examples
Earlier quoted context omitted.
That is against their ToS though if you use your new LLM commercially.
And yet they trained theirs on commercial content on the internet. If that’s legal I doubt their argument holds up in court right?
Earlier quoted context omitted.
So what are they going to do about it?
Great question! I don’t know the end game there. Maybe if they suspected their model was used they would sue, and in discovery find you used their model for training?
> Update 05/22/2023
> We are happy to release our 700B token checkpoint for the OpenLLaMA 7B model and 600B token checkpoint for the 3B model. We’ve also updated the evaluation results. We expect the full 1T token training run to finish at the end of this week.
https://github.com/openlm-research/open_llama
So we could develop on LLaMA for now and switch to OpenLLaMA later.
Earlier quoted context omitted.
Yup, totally. This is a form of knowledge distillation. Openai, or other foundational model providers, can't really do anything about it.
Well they can sue you and bankrupt you by delaying trial for a decade. That's how the US patent system works anyways...
Earlier quoted context omitted.
That is against their ToS though if you use your new LLM commercially.
And yet they trained theirs on commercial content on the internet. If that’s legal I doubt their argument holds up in court right?
You signed up and agreed to their TOS to use GPT-4.
The legal situations are not similar.
OTOH, lots of people are openly using GPT-4 in one way or another to develop models, though they might generally be at arm’s length from people intending to sell services.
Earlier quoted context omitted.
That is against their ToS though if you use your new LLM commercially.
So what are they going to do about it?
If they think they can prove you used it to develop a competing service, sue you for breaking the TOS and recover the greater of the harm it did to their business or the amount of your profits from the service that are due to the uae of GPT-4 in violation of the agreement.