GPT-4o • Hacker News Board

Re: GPT-4o

#31

Post by minimaxir » Mon, May 13, 2024, 5:32 PM UTC

atgctg wrote: post #19

Tiktoken added support for GPT-4o: https://github.com/openai/tiktoken/commit/9d01e5670ff50eb74c... It has an increased vocab size of 200k.

For posterity, GPT-3.5/4's tokenizer was 100k. The benefit of a larger tokenizer is more efficient tokenization (and therefore cheaper/faster) but with massive diminishing returns: the larger tokenizer makes the model more difficult to train but tends to reduce token usage by 10-15%.

Re: GPT-4o

#32

Post by syntaxing » Mon, May 13, 2024, 5:33 PM UTC

I admit I drink the koolaid and love LLMs and their applications. But damn, the way it’s responds in the demo gave me goosebumps in a bad way. Like an uncanny valley instincts kicks in.

Re: GPT-4o

#33

Post by hubraumhugo » Mon, May 13, 2024, 5:33 PM UTC

The movie Her has just become reality

Re: GPT-4o

#34

Post by InfiniteVortex » Mon, May 13, 2024, 5:34 PM UTC

GalaxyNova wrote: post #15

It is really cool that they are bringing this to free users. It does make me wonder what justifies ChatGPT plus now though...

they stated that they will be announcing something new that is on the next frontier (or close to it IIRC) soon. so there will definitely be an incentive to pay because it will be something better than gpt 4o.

Re: GPT-4o

#35

Post by 6556jkkk » Mon, May 13, 2024, 5:34 PM UTC

[flagged]

Re: GPT-4o

#36

Post by hmmmhmmmhmmm » Mon, May 13, 2024, 5:34 PM UTC

With the news that Apple and OpenAI are closing / just closed a deal for iOS 18, it's easy to speculate we might be hearing about that exciting new model at WWDC...

Re: GPT-4o

#37

Post by chatcode » Mon, May 13, 2024, 5:34 PM UTC

Parsing emotions in vocal inflections (and reliably producing them in vocal output) seems quite under-hyped in this release.

That seems to represent an entirely new depth of understanding of human reality.

Re: GPT-4o

#38

Post by rvz » Mon, May 13, 2024, 5:34 PM UTC

Given that they are moving all these features to free users, it tells us that GPT-5 is around the corner and is significantly much better than their previous models.

Re: GPT-4o

#39

Post by PoignardAzur » Mon, May 13, 2024, 5:34 PM UTC

Holy crap, the level of corporate cringe of that "two AIs talk to each other" scene is mind-boggling.

It feels like a pretty strong illustration of the awkwardness of getting value from recent AI developments. Like, this is technically super impressive, but also I'm not sure it gives us anything we couldn't have one year ago with GPT-4 and ElevenLabs.

Re: GPT-4o

#40

Post by sourcecodeplz » Mon, May 13, 2024, 5:34 PM UTC

It is quite nice how they keep giving premium features for free, after a while. I know openai is not open and all but damn, they do give some cool freebies.