Live data from Hacker News

OpenAI’s CEO says the age of giant AI models is already over

wired.com

521–525 of 525 posts

Re: OpenAI’s CEO says the age of giant AI models is already over

#522

Earlier quoted context omitted.

Some of us prefer to surf the internet without reddit leaking everywhere.

"rent free" is reddit leaking much more than bringing up a politician for a complaint.

So your response is "no u"

Ok, cool.

Re: OpenAI’s CEO says the age of giant AI models is already over

#523

Earlier quoted context omitted.

"rent free" is reddit leaking much more than bringing up a politician for a complaint.

So your response is "no u" Ok, cool.

A little bit.

It's not like an accusation of hypocrisy is automatically wrong, or anything.

It really confuses me why you think such a mundane political statement is a reddit thing. Especially if you think the rent free thing isn't reddity, in which case you're not drawing with a super broad brush in a way I could at least understand.

Re: OpenAI’s CEO says the age of giant AI models is already over

#524

Earlier quoted context omitted.

This tells me you haven't really stress tested the model. GPT is currently at the stage of "person who is at the meeting, but not really paying attention so you have to call them out". Once GPT is pushed, it scrambles and falls over for most applications. The failure modes range from contradicting itself, making up things for applications that shouldn't allow it, to ignoring prompts, to simply being unable to perform…

Are we talking about bare GPT through the UI, or GPT with a framework giving it access to external systems and the ability to store and retrieve data? Because, yeah, “brain in a jar” GPT isn’t enough for most tasks beyond parlor-trick chat, but being used as a brain in a jar isn’t the point.

We have given it extensions, and really the extensions do a lot of the work. The tool that judges the style and correctness of the text based on the embedding is doing much of the heavy lifting. GPT essentially handles generating text and dense representations of the text.

Re: OpenAI’s CEO says the age of giant AI models is already over

#525
post #435

Earlier quoted context omitted.

I've been training large 65b models on "rent for N hours" systems for less than 1k per customized model. Then fine tuning those to be whatever I want for even cheaper. 2 months since gpt 4. This ride has only just started, fasten your whatevers.

You are confusing training with fine-tuning which is a different beast.

No I'm not, it's the full model on 8 gpus for a couple hundred. After training I fine tune for chats but mostly command and control tools, and then you fine-tune for application.
Post reply on HN