Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5 is behind schedule

wsj.com

Post reply on HN
Print view View original

111–120 of 1001 posts

Re: GPT-5 is behind schedule

#111

Post by RedNifre »

psb217 wrote: post #73
noman-land wrote: post #69

Earlier quoted context omitted.

I completely don't understand the use for synthetic data. What good it's it to train a model basically on itself?

The value of synthetic data relies on having non-zero signal about which generated data is "better" or "worse". In a sense, this what reinforcement learning is about. Ie, generate some data, have that data scored by some evaluator, and then feed the data back into the model with higher weight on the better stuff and lower weight on the worse stuff. The basic loop is: (i) generate synthetic data, (ii) rate synthetic d…

But who rates the synthetic data? If it is humans, I can understand that this is another way to get human knowledge into it, but if it's rated by AI, isn't it just a convoluted way of copying the rating AI's knowledge?

Re: GPT-5 is behind schedule

#112

Post by sdwr »

ericskiff wrote: post #25

What we can reasonably assume from statements made by insiders: They want a 10x improvement from scaling and a 10x improvement from data and algorithmic changes The sources of public data are essentially tapped Algorithmic changes will be an unknown to us until they release, but from published research this remains a steady source of improvement Scaling seems to stall if data is limited So with all of that taken toge…

Great improvements and all, but they are still no closer (as of 4o regular) to having a system that can be responsible for work. In math problems, it forgets which variable represents what, in coding questions it invents library fns.

I was watching a YouTube interview with a "trading floor insider". They said they were really being paid for holding risk. The bank has a position in a market, and it's their ass on the line if it tanks.

ChatGPT (as far as I can tell) is no closer to being accountable or responsible for anything it produces. If they don't solve that (and the problem is probably inherent to the architecture), they are, in some sense, polishing a turd.

Re: GPT-5 is behind schedule

#113

Post by simonw »

"OpenAI’s is called GPT-4, the fourth LLM the company has developed since its 2015 founding." - that sentence doesn't fill me with confidence in the quality of the rest of the article, sadly.

Re: GPT-5 is behind schedule

#114

Post by aswegs8 »

dartos wrote: post #48
Stevvo wrote: post #31

Earlier quoted context omitted.

"With o3 now public knowledge, imagine how long it’s been churning out new thinking at expert level across every field." I highly doubt that. o3 is many orders of magnitude more expensive than paying subject matter experts to create new data. It just doesn't make sense to pay six figures in compute to get o3 to make data a human could make for a few hundred dollars.

That’s an interesting idea. What if OpenAI funded medical research initiatives in exchange for exclusive training rights on the research.

Wait didn't they just recently request researchers to pair up with them in exchange for the data?

Re: GPT-5 is behind schedule

#115

Post by avidphantasm »

I’m not smart enough or interesting enough to be hired by OpenAI to expertly solve problems and explain how to the AI. However, I like to think there isn’t enough money in the world for me to sell out my colleagues like that.

Re: GPT-5 is behind schedule

#116

Post by throwaway314155 »

kelsey98765431 wrote: post #27
PittleyDunkin wrote: post #21

Everyone's comparing o1 and claude, but neither really work well enough to justify paying for them in my experience for coding. What I really want is a mode where they ask clarifying questions , ideally many of them, before spitting out an answer. This would greatly improve utility of producing something with more value than an auto-complete.

have you tested that this helps? seems pretty simple to script with an agent framework

Or just f-strings.

Re: GPT-5 is behind schedule

#117

Post by 404mm »

simonw wrote: post #113

"OpenAI’s is called GPT-4, the fourth LLM the company has developed since its 2015 founding." - that sentence doesn't fill me with confidence in the quality of the rest of the article, sadly.

Quite funny that an article about AI was not fed to AI to proof read it.

Re: GPT-5 is behind schedule

#118

Post by throwaway314155 »

ionwake wrote: post #15
david-gpu wrote: post #8

What I find odd is that o1 doesn't support attaching text documents to chats the way 4o does. For a model that specializes in reasoning, reading long documents seems like a natural feature to have.

If Sama ever reads this, I have no idea why no users seem to focus on this, but it would be really good to prioritise being able to select which model you can use with the custom myGPTs. I know this maybe hard or not possible without recreating them , but I still dont think it's possible. I dont think most customers realise how much better the models work with custom GPTs.

At this point I think it's safe to say they have given up on custom GPTs.

Re: GPT-5 is behind schedule

#119

Post by __loam »

beacon294 wrote: post #19
jsheard wrote: post #13

Earlier quoted context omitted.

[flagged]

There's someone with this comment in every thread. Meanwhile, no one answers this because they are getting value. Please take the time to learn, it will give you value.

Something can generate value and still have negative unit economics.

Re: GPT-5 is behind schedule

#120

Post by bwhiting2356 »

I want AI to help me in the physical world: folding my laundry, cooking and farming healthy food, cleaning toilets. Training data is not lying around on the internet for free, but it's also not impossible. How much data do you need? A dozen warehouses full of robots folding and unfolding laundry 24/7 for a few months?
Post reply on HN