OpenAI Progress • Hacker News Board

Re: OpenAI Progress

#121

Post by ceejayoz » Sat, Aug 16, 2025, 11:16 PM UTC

isaacremuant wrote: post #116

ceejayoz wrote: post #110

Earlier quoted context omitted.

Because it’s embarrassing and they manually patch it out every time like a game of Whack-a-Mole?

Except people use the same examples like blueberry and strawberry, which were used months ago, as if they're current. These models can also call Counter from python's collections library or whatever other algorithm. Or are we claiming it should be a pure LLM as if that's what we use in the real world. I don't get it, and I'm not one to hype up LLMs since they're absolutely faulty, but the fixation over this example s…

It’s such a great example precisely for that reason - despite efforts, it comes back every time.

Re: OpenAI Progress

#122

Post by gordon_freeman » Sat, Aug 16, 2025, 11:17 PM UTC

It seems like the progress from GPT-4 to GPT-5 has plateaued: for most prompts, I actually find GPT-4 more understandable than GPT-5 [1].

[1] Read the answers from GPT-4 and 5 for this math question: "Ugh I hate math, integration by parts doesn't make any sense"

Re: OpenAI Progress

#123

Post by goatlover » Sat, Aug 16, 2025, 11:18 PM UTC

starchild3001 wrote: post #107

I’m baffled by claims that AI has “hit a wall.” By every quantitative measure, today’s models are making dramatic leaps compared to those from just a year ago. It’s easy to forget that reasoning models didn’t even exist a year back! IMO Gold, Vibe coding with potential implications across sciences and engineering? Those are completely new and transformative capabilities gained in the last 1 year alone. Critics argue…

Is the stated fact undeniable? Because a lot of people have been contesting it. This reads like PR to counter the widespread GPT-5 criticism and disappointment.

Re: OpenAI Progress

#124

Post by platevoltage » Sat, Aug 16, 2025, 11:19 PM UTC

ddtaylor wrote: post #118

So we're at the corporate dick wagging part of the process?

That Koeningsegg isn't gonna pay for itself.

Re: OpenAI Progress

#125

Post by behnamoh » Sat, Aug 16, 2025, 11:20 PM UTC

starchild3001 wrote: post #107

I’m baffled by claims that AI has “hit a wall.” By every quantitative measure, today’s models are making dramatic leaps compared to those from just a year ago. It’s easy to forget that reasoning models didn’t even exist a year back! IMO Gold, Vibe coding with potential implications across sciences and engineering? Those are completely new and transformative capabilities gained in the last 1 year alone. Critics argue…

it has become progressively easier to game benchmarks in order to appear higher in rankings. I’ve seen several models that claimed they were the best in software engineering only to be disappointed by them not figuring out the most basic coding problems. In comparison, I’ve seen models that don’t have much hype, but are rock solid.

When people say AI has hit a wall, they mainly talk about OpenAI losing its hype and grip on the state of the art models.

Re: OpenAI Progress

#126

Post by magospietato » Sat, Aug 16, 2025, 11:21 PM UTC

There is a quiet poetry to GPT1 and GPT2 that's lost even in the text-davinci output. I often wonder what we lose through reinforcement.

Re: OpenAI Progress

#127

Post by [deleted] » Sat, Aug 16, 2025, 11:25 PM UTC

isaacremuant wrote: post #55

raincole wrote: post #26

I thought the response to "what would you say if you could talk to a future AI" would be "how many r in strawberry".

Can we stop with that outdated meme? What model can't answer that effectively?

[deleted]

Re: OpenAI Progress

#128

Post by codezero » Sat, Aug 16, 2025, 11:25 PM UTC

magospietato wrote: post #126

There is a quiet poetry to GPT1 and GPT2 that's lost even in the text-davinci output. I often wonder what we lose through reinforcement.

You can run GPT1 and 2 on consumer hardware so nothing is preventing you from exploring that art :)

Re: OpenAI Progress

#129

Post by Workaccount2 » Sat, Aug 16, 2025, 11:30 PM UTC

starchild3001 wrote: post #107

I’m baffled by claims that AI has “hit a wall.” By every quantitative measure, today’s models are making dramatic leaps compared to those from just a year ago. It’s easy to forget that reasoning models didn’t even exist a year back! IMO Gold, Vibe coding with potential implications across sciences and engineering? Those are completely new and transformative capabilities gained in the last 1 year alone. Critics argue…

The prospect of AI not hitting a wall is terrifying to many people for understandable reasons. In situations like this you see the full spectrum of coping mechanisms come to the surface.

Re: OpenAI Progress

#130

Post by Workaccount2 » Sat, Aug 16, 2025, 11:32 PM UTC

goatlover wrote: post #123

starchild3001 wrote: post #107

I’m baffled by claims that AI has “hit a wall.” By every quantitative measure, today’s models are making dramatic leaps compared to those from just a year ago. It’s easy to forget that reasoning models didn’t even exist a year back! IMO Gold, Vibe coding with potential implications across sciences and engineering? Those are completely new and transformative capabilities gained in the last 1 year alone. Critics argue…

Is the stated fact undeniable? Because a lot of people have been contesting it. This reads like PR to counter the widespread GPT-5 criticism and disappointment.

To be fair, the bull of GPT-5 complaining comes from a vocal minority pissed that their best friend got swapped out. The other minority is unhinged AI fanatics thinking GPT-5 would be AGI.