New models and developer products • Hacker News Board

Re: New models and developer products

#71

Post by whytai » Mon, Nov 06, 2023, 7:28 PM UTC

Every day this video ages more and more poorly [1].

categories of startups that will be affected by these launches:

- vectorDB startups -> don't need embeddings anymore

- file processing startups -> don't need to process files anymore

- fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming

- cost reduction startups -> they literally lowered prices and increased rate limits

- structuring startups -> json mode and GPT4 turbo with better output matching

- vertical ai agent startups -> GPT marketplace

- anthropic/claude -> now GPT-turbo has 128k context window!

That being said, Sam Altman is an incredible founder for being able to have this close a watch on the market. Pretty much any "ai tooling" startup that was created in the past year was affected by this announcement.

For those asking: vectorDB, chunking, retrieval, and RAG are all implemented in a new stateful AI for you! No need to do it yourself anymore. [2] Exciting times to be a developer!

[1] https://youtu.be/smHw9kEwcgM

[2] https://openai.com/blog/new-models-and-developer-products-an...

Re: New models and developer products

#72

Post by singularity2001 » Mon, Nov 06, 2023, 7:30 PM UTC

freedomben wrote: post #55

WanderPanda wrote: post #42

Earlier quoted context omitted.

Yep I feel like they solved the problem that Apple never managed to solve with Siri: How to interface it with apps. Seems like this was an LLM-hard problem

My guess is an LLM-based Siri is right around the corner. Apple commonly waits for tech to be proved by others before adopting it, so this would be in-line with standard operating procedures.

My guess is that LLM-Siri will be crippled by internal processes and lawyers

Re: New models and developer products

#73

Post by dang » Mon, Nov 06, 2023, 7:34 PM UTC

modeless wrote: post #12

Whisper V3 is released! https://github.com/openai/whisper/commit/c5d42560760a05584c1... Looks like it's just a new checkpoint for the large model. It would be nice to have updates for the smaller models too. But it'll be easy to integrate with anything using Whisper V2. I'm excited to add it to my local voice AI ( https://www.microsoft.com/store/apps/9NC624PBFGB7 ) I assume ChatGPT voice has been using Whisper V3 and…

Re: New models and developer products

#74

Post by schrodingerscow » Mon, Nov 06, 2023, 7:36 PM UTC

I’m confused by the pricing. Gpt-4 turbo appears to be better in every way, but is 3x cheaper?!

Re: New models and developer products

#75

Post by dragonwriter » Mon, Nov 06, 2023, 7:37 PM UTC

kvn8888 wrote: post #70

tornato7 wrote: post #62

Earlier quoted context omitted.

GPT-4 Turbo is already available by default in ChatGPT

I can't find anything that says it's available in ChatGPT

ChatGPT (at least in Plus) when using the GPT-4 model selected (instead of GPT-3.5) currently consistently reports the April 2023 knowledge cutoff of GPT-4-Turbo (gpt-4-1106-preview/gpt-4-vision-preview) as its knowledge cutoff, not the Sep 2021 cutoff for gpt-4-0613, the most recent pre-turbo GPT-4 model release.

The most sensible explanation is that ChatGPT is using GPT-4-Turbo as its GPT-4 model.

Re: New models and developer products

#76

Post by singularity2001 » Mon, Nov 06, 2023, 7:37 PM UTC

chipgap98 wrote: post #21

The Assistants playground doesn't seem to be available yet

https://chat.openai.com/gpts/editor

you currently do not have access to this feature :(

Re: New models and developer products

#77

Post by dragonwriter » Mon, Nov 06, 2023, 7:40 PM UTC

in3d wrote: post #17

zavertnik wrote: post #13

And here I was in bliss with the 32k context increase 3 days ago. 128k context? Absolutely insane. It feels like now the bottle neck in GPT workflows is no longer GPT, but instead its the wallet! Such an amazing time to be alive.

For GPT-4 Turbo, not GPT-4.

GPT-4-Turbo seems to be replacing GPT-4 (non-turbo); the GPT-4 (non-turbo) model is marked as "Legacy" in the model list.

EDIT: the above is corrected, it previously erroneously said the non-turbo model was marked as "deprecated", which is a different thing.

Re: New models and developer products

#78

Post by tornato7 » Mon, Nov 06, 2023, 7:40 PM UTC

According to [1], the new gpt-4-1106-preview model should be available to all, but the API is telling me "The model `gpt-4-1106-preview` does not exist or you do not have access to it."

Anyone able to call it from the API?

1. https://help.openai.com/en/articles/8555510-gpt-4-turbo

Re: New models and developer products

#79

Post by Der_Einzige » Mon, Nov 06, 2023, 7:41 PM UTC

whytai wrote: post #71

Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…

Startups built around actual AI tools, like if one formed around automatic1111 or oogabooga, would be unaffected, but because so much VC money went to the wrong places in this space, a whole lot of people are about to be burned hard.

Re: New models and developer products

#80

Post by dragonwriter » Mon, Nov 06, 2023, 7:41 PM UTC

schrodingerscow wrote: post #74

I’m confused by the pricing. Gpt-4 turbo appears to be better in every way, but is 3x cheaper?!

The same as true of GPT-3.5-turbo compared to the GPT-3 models which preceded it.

They want everyone on GPT-4-turbo. It may also be a smaller (or otherwise more efficient) but more heavily trained model that is cheaper to do inference on.