71–80 of 244 posts
Given that they're offering davinci-002 for completion, I was wondering whether they went back to offering an "unsafe" model, but both davinci-002 and babbage-002 enter an infinite loop for any "unsafe" completion where text-davinci-003 and text-curie-001 is fine. Sigh, I guess OpenAI really does not want to offer unsafe models for usage.
Question about privacy: OpenAI doesn't use API calls to train their models. But do they or Microsoft still store the text? If so, for how long? Overall, I think this is great, and can't wait for the 16k fine-tuning.
https://learn.microsoft.com/en-us/legal/cognitive-services/o...
Given that they're offering davinci-002 for completion, I was wondering whether they went back to offering an "unsafe" model, but both davinci-002 and babbage-002 enter an infinite loop for any "unsafe" completion where text-davinci-003 and text-curie-001 is fine. Sigh, I guess OpenAI really does not want to offer unsafe models for usage.
This is honestly pretty disappointing. * No function calling support yet * Only 4k tokens, so can't use the full 16k token length. I really wish they'd share some info as to if we'll be able to fine tune the multimodality of GPT-4 as well.
> multimodality of GPT-4 Is there a multimodal GPT 4 model in the wild? All I saw was that one example at launch.
This is honestly pretty disappointing. * No function calling support yet * Only 4k tokens, so can't use the full 16k token length. I really wish they'd share some info as to if we'll be able to fine tune the multimodality of GPT-4 as well.
Literally the first sentence in the article:
> Fine-tuning for GPT-3.5 Turbo is now available, with fine-tuning for GPT-4 coming this fall.
Given that they're offering davinci-002 for completion, I was wondering whether they went back to offering an "unsafe" model, but both davinci-002 and babbage-002 enter an infinite loop for any "unsafe" completion where text-davinci-003 and text-curie-001 is fine. Sigh, I guess OpenAI really does not want to offer unsafe models for usage.
What is an "unsafe" model?
Are there major advantages of GPT-3.5 Turbo tuning over PEFT/LoRA with Llama2?
GPT-3.5 is much, much smarter than Llama2. Its not nearly as close as the benchmarks make it seem.
In case of openAI, the infra doesn't needs to be rented but the cost is covered in usage pricing but want to hear from someone who has experience fine-tuning Llama2 models that how it compares.
Are there major advantages of GPT-3.5 Turbo tuning over PEFT/LoRA with Llama2?
GPT-3.5 is much, much smarter than Llama2. Its not nearly as close as the benchmarks make it seem.
It is able to use the knowledge graph to write coherent text that is well structured, lengthy, and follows the connections outlined in the graph to the logical conclusions, while deriving non-explicit insights from the graph in it's writings.
Just to say, i've seen a giant improvement in performance from Llama2 by fine tuning. And like I said, just 13b...I am perfecting the dataset with 13b before moving to 70b.
3.5-turbo is sometimes okay, i've tested it moderately for the same tasks i've been training/testing Llama2 on, and it's just a bit behind. Honestly, my fine tune is more consistent than gpt4 for a good number of the tasks i've trained.
> It is very important to us that the deployment of fine-tuning is safe. To preserve the default model's safety features through the fine-tuning process, fine-tuning training data is passed through our Moderation API and a GPT-4 powered moderation system to detect unsafe training data that conflict with our safety standards. I wish there was some documentation on what kinds of things are determined unsafe. There are…
You can see the list of things the moderation endpoint scans for in the OpenAI documentation: https://platform.openai.com/docs/guides/moderation/overview I'm unsure of what the "GPT-4 powered moderation system" entails, though. Conjecture: My unsubstantiated guess would be them prompting GPT-4 with something like "Is the following excerpt considered to be harmful or unsafe: {training data}" and then limiting the outp…