GPT-4 API General Availability

Post by BoorishBears » Thu, Jul 06, 2023, 10:26 PM UTC

simonw wrote: post #206

flangola7 wrote: post #184

Earlier quoted context omitted.

They address that, OpenAI will cover the cost of re-training on the new models, and the old models don't discontinue until next year.

Did they say they would cover the cost of fine-tuning again? I saw them say they would cover the cost of recalculating embeddings, but I didn't see the bit about fine-tuning costs. On fine-tuning: > We will be providing support to users who previously fine-tuned models to make this transition as smooth as possible. On embeddings: > We will cover the financial cost of users re-embedding content with these new models.

Post by system2 » Thu, Jul 06, 2023, 10:32 PM UTC

superkuh wrote: post #84

Yikes. They're actually killing off text-davinci-003. RIP to the most capable remaining model and RIP to all text completion style freedom. Now it's censored/aligned chat or instruct models with arbitrary input metaphor limits for everything. gpt3.5-turbo is terrible in comparison. This will end my usage of openai for most things. I doubt my $5-$10 API payments per month will matter. This just lights more of a fire u…

Post by Robotbeat » Thu, Jul 06, 2023, 10:35 PM UTC

Fyrezerk wrote: post #231

thomasfromcdnjs wrote: post #221

Earlier quoted context omitted.

The Chat-GPT models are all pre-prompted and pre-aligned. If you work with davinci-003, it will never say things like, "I am an OpenAI bot and am unable to work with your unethical request" When using davinci the onus is on you to construct prompts (memories) which is fun and powerful. ==== 97% of API usage might be because of ChatGPT's general appeal to the world. But I think they will be losing a part of the hacker…

The hacker/builder ethos doesn't matter in the grand scheme of commercialization.

Post by r3trohack3r » Thu, Jul 06, 2023, 10:38 PM UTC

fnordpiglet wrote: post #180

alpark3 wrote: post #174

>Developers wishing to continue using their fine-tuned models beyond January 4, 2024 will need to fine-tune replacements atop the new base GPT-3 models (ada-002, babbage-002, curie-002, davinci-002), or newer models (gpt-3.5-turbo, gpt-4). Once this feature is available later this year, we will give priority access to GPT-3.5 Turbo and GPT-4 fine-tuning to users who previously fine-tuned older models. We acknowledge…

If you don’t own the weights you don’t own anything. This is why open models are so crucial. I don’t understand any business who is building fine tuned models against closed models.

Post by swores » Thu, Jul 06, 2023, 10:43 PM UTC

popinman322 wrote: post #204

ravenstine wrote: post #30

Earlier quoted context omitted.

It's definitely gotten better, but yeah, it really doesn't reliably support what I'm currently working on. My project takes transcripts from YouTube, which don't have punctuation, splits them up into chunks, and passes each chunk to GPT-4 telling it to add punctuation with paragraphs. Part of the instructions includes telling the model that, if the final sentence of the chunk appears incomplete, to just try to comple…

I've done exactly this for another project. I'd recommend grabbing an open source model and fine-tuning on some augmented data in your domain. For example: I grabbed tech blog posts, turned each post into a collection of phonemes, reconstructed the phonemes into words, added filler words, and removed punctuation+capitalization.