Live data from Hacker News

GPT-3.5 Turbo fine-tuning and API updates

openai.com

1–10 of 244 posts

Re: GPT-3.5 Turbo fine-tuning and API updates

#3
"fine-tuning training data is passed through our Moderation API and a GPT-4 powered moderation system", that sounds expensive, I imagine they would use GPT-4 only when the "safety" is ambiguous, training a model is less expensive than running GPT-4 inference by looking at the API price.

Re: GPT-3.5 Turbo fine-tuning and API updates

#7

Generating from a finetuned GPT 3.5 Turbo is 8x the cost of generating from the base model, so you really have to be in the “reduce prompt size by 90%” bucket they mention to get cost effectiveness out of it.

i didn't catch that but getting consistency is probably worth it in most cases. depends on your budget

Re: GPT-3.5 Turbo fine-tuning and API updates

#8

Generating from a finetuned GPT 3.5 Turbo is 8x the cost of generating from the base model, so you really have to be in the “reduce prompt size by 90%” bucket they mention to get cost effectiveness out of it.

I wonder why is much more expensive.
Post reply on HN