goddamn it i hate ai
GPT-3.5 Turbo fine-tuning and API updates
161–170 of 244 posts
Re: GPT-3.5 Turbo fine-tuning and API updates
#162And OpenAI continues to ship. As promised, they released GPT3.5 fine-tuning today. They opened GPT4 API access a few months ago. In a few months, they'll release GPT4 fine-tuning. Many favor open source AI, and criticize OpenAI for not being open enough. But the most important thing is, OpenAI innovates. Fast. Llama, Bard, FB's open source stuff is good but it's lightyears behind OpenAI. You have to credit them for t…
And they have 700 employees. Just that's it. Incredible.
The number of Google employees performing a similar function is probably not so different.
Re: GPT-3.5 Turbo fine-tuning and API updates
#163And OpenAI continues to ship. As promised, they released GPT3.5 fine-tuning today. They opened GPT4 API access a few months ago. In a few months, they'll release GPT4 fine-tuning. Many favor open source AI, and criticize OpenAI for not being open enough. But the most important thing is, OpenAI innovates. Fast. Llama, Bard, FB's open source stuff is good but it's lightyears behind OpenAI. You have to credit them for t…
I love how far behind Facebook and google are. I’ve always said they weren’t hiring the best, but rather are monopolies sucking the air out of the room. This proves it.
Re: GPT-3.5 Turbo fine-tuning and API updates
#164Safety standards. One might call it "our censorship model" but that would be too close to the truth, so call it safety standards...
Re: GPT-3.5 Turbo fine-tuning and API updates
#165Generating from a finetuned GPT 3.5 Turbo is 8x the cost of generating from the base model, so you really have to be in the “reduce prompt size by 90%” bucket they mention to get cost effectiveness out of it.
I think of fine-tuning as an avenue to significantly reduce LLM inference costs, so I think this is an exciting development. You're right if you compare GPT-3.5-turbo to fine-tuned GPT-3.5-turbo, but if it's anything like fine-tuning the Llama-2 models, you'll be able to achieve GPT-4 level performance for a wide range of practical use cases (SQL query generation is an example), but probably not for math or coding (at least not without fine-tuning on a significant amount of data).
In fact, we've seen GPT-4 level performance from even the 7B Llama-2 model after fine-tuning. [1]
[1] https://www.anyscale.com/blog/fine-tuning-llama-2-a-comprehe...
Re: GPT-3.5 Turbo fine-tuning and API updates
#166And OpenAI continues to ship. As promised, they released GPT3.5 fine-tuning today. They opened GPT4 API access a few months ago. In a few months, they'll release GPT4 fine-tuning. Many favor open source AI, and criticize OpenAI for not being open enough. But the most important thing is, OpenAI innovates. Fast. Llama, Bard, FB's open source stuff is good but it's lightyears behind OpenAI. You have to credit them for t…
I love how far behind Facebook and google are. I’ve always said they weren’t hiring the best, but rather are monopolies sucking the air out of the room. This proves it.
How is Facebook behind?
They've released the most powerful open source LLM models so far (Llama 1 + 2) and are a serious threat to the Openai closed-source monopoly.
Re: GPT-3.5 Turbo fine-tuning and API updates
#167> For example, a gpt-3.5-turbo fine-tuning job with a training file of 100,000 tokens that is trained for 3 epochs would have an expected cost of $2.40.
How do you calculate the number of tokens required?
Re: GPT-3.5 Turbo fine-tuning and API updates
#168Earlier quoted context omitted.
How are you currently hosting your LLaMA 2? Any tips, tricks or advice?
It depends on your needs. For instance, do you want to host an API or do you want to have a front end like chatGPT? Chances are, text-generation-webui [1] should get you pretty close to hosting it yourself. You simply clone the repo, download the model from huggingface using the included helper (download-model.py) and fire up the server with server.py. You can connect to it by SSH port tunneling on port 7860 (there's…
If you want to query the Llama-2 models, you can use Anyscale Endpoints [1]. Note: I work on this :)
Llama-2-70B is $1 / million tokens, which is the most cost-efficient on the market that I'm aware of.
Re: GPT-3.5 Turbo fine-tuning and API updates
#169[dead]
Re: GPT-3.5 Turbo fine-tuning and API updates
#170Safety standards. One might call it "our censorship model" but that would be too close to the truth, so call it safety standards...
Do people really wish for OpenAI models to output healthcare advices without disclaimers, plans to end humanity, child porn fictions, torture instruction books, and similar?
The minute it happens without complicated bypasses, the society would say stop to generative ai, and rightfully so. Many people already got spoked when they tricked ChatGPT to say/repeat scary things.