Live data from Hacker News

A recent experience with ChatGPT 5.5 Pro

gowers.wordpress.com

231–240 of 558 posts

Re: A recent experience with ChatGPT 5.5 Pro

#231
post #59

Earlier quoted context omitted.

It’s a classic example of the best positioned people being in the best position to keep reaping all the rewards. There’s the example of a poor person and a rich person buying boots. The poor person’s boots wear out and have to be replaced while the rich persons boots last for many years due to higher quality craftsmanship. Over years, the poor person’s boots wear will pay may for boots.

I know the example, but as a counter-argument: often more expensive boots are not more durable. It’s about spending time to learn to spot the quality. Of course if you are really poor, then you have to take expensive shortcuts, but for most people that shouldn’t be the case. Learning to do more with less money isn’t as bad as many people think. It’s also good for the brain to be a bit more creative.

> Learning to do more with less money isn’t as bad as many people think.

We are wading into philosophy here, but I believe this analogy doesn't track in this case -- my suspicion from this blog post and others is that already today, the Pro level thinking models are a positive multiplier to your research output similar to how the models one level lower are a multiplier to one's programming output.

Maybe one can someday use the cheaper models similar to how you can use cheaper models than Opus/5.5 and still be nearly as productive as a programmer -- but I am trying and failing doing exactly that for research questions.

Re: A recent experience with ChatGPT 5.5 Pro

#232

Earlier quoted context omitted.

I agree and put it this way: LLMs sound so convincing presenting you the work it does rose colored and promising to give you more if you keep going. There is a 50/50 chance that it turns out to be right or letting you jump of the cliff. Only the trip stays the same beautiful 5 star plus travel. Also, spotting an error and telling LLM makes it in most cases worse, because the LLM wants to please you and goes on to apo…

Reusing the same prompt several times is something I've started doing too. The contrast is often illuminating. In one case, it made a thoroughly convincing argument that an approach was justified. The second time it made exactly the opposite argument, which was equally compelling. I now see LLMs as persuasion machines.

Ever since they started getting really sycophantic, I’ve been presenting my ideas as “my co-worker says this is a good approach but I disagree, can you help me convince him that it’s wrong?”

Re: A recent experience with ChatGPT 5.5 Pro

#233

I am a physics professor and often use Gemini to check my papers. It is a formidable tool: it was able to find a clerical error (a missing imaginary unit in a complex mathematical expression) I was not able to find for days, and it often underlines connections between concepts and ideas that I overlooked. However, it often makes conceptual errors that I can spot only because I have good knowledge of the topic I am di…

We've got a rather extensive AI setup through our equity fund and I've setup a group of agents for data architecture at scale. One is the main agent I discuss with and it's setup to know our infrastructure and has access to image generation tools, websearch, hand off agents and other things. I tend to use Opus (4-6 currently) and I find it to be rather great. As you point out it comes with the danger of making mistak…

Are you using this agent hive for any repeatable tasks? What you described, superficially, seems like a one off. Genuinely curious.

Re: A recent experience with ChatGPT 5.5 Pro

#234
post #166

> "Even though I can motivate it in retrospect, ChatGPT’s idea to use h^2-dissociated sets to control relations of order at most h feels quite ingenious. As far as I can tell, this idea is completely original." The question that keep bothering me is can an LLM generate an idea that is truly novel? How would/could that actually happen? But then that leads to the question - what are we actually doing when we think? Per…

Yes, they can. Some people like to parrot "next token prediction", "LLMs can only interpolate", and other nonsense, but it is obviously not true for many reasons, in particular since we introduced RL. Humans do not have the monopoly on generating novel ideas, modern AI models using post training, RL etc can come to them in the same way we do, exploration. See also verifier's law [0]: "The ease of training AI to solve…

Reinforcement learning for "reasoning" perturbs the model to generate completions in a particular chain of thought / alternative selection structure. It's three next token predictors in a trench coat.

Re: A recent experience with ChatGPT 5.5 Pro

#235
post #35

Earlier quoted context omitted.

I mean in the same way getting Wolfram Alpha to solve a really hard/ugly differential equation I suppose

Insane that we have a system capable of making innovative math proofs and people dismiss it as unimpressive

The creation of the system is deeply impressive, so are compilers but I don't raise a toast to it each time I build my code. Like generated art, people aren't going appreciate it on the same level.

Re: A recent experience with ChatGPT 5.5 Pro

#236
post #141

Earlier quoted context omitted.

I assume you're using the "regular" Pro version of Gemini 3.1 for the above, rather than the Deep Think mode, which is more comparable to GPT-5.5 Pro. To my knowledge, regular 3.1 Pro is a tier below and often makes mistakes. Moreover, there's no reason to believe the progress of LLMs, which couldn't reliably solve high-school math problems just 3–4 years ago, will stop anytime soon. You might want to track the progr…

> there's no reason to believe the progress of LLMs [...] will stop anytime soon Wrong. Every advancement has followed a s curve. Where we are on that curve is anyones guess. Or maybe "this time its different".

It can be S curve (and it almost surely is), but on every chart you can plot, you don't see even of an inkling of the bend yet.

Re: A recent experience with ChatGPT 5.5 Pro

#237
post #194

Earlier quoted context omitted.

The standard networking connection has been called “Ethernet” for more than thirty years, so networking has stagnated, right?

If higher bandwidth networking consisted primarily running more and more ethernet lines in parallel, you would most certainly agree that "networking has stagnated". "Reasoning" and now "Agentic" AI systems are not some fundamental improvement on LLMs, they're just running roughly the same prior-gen LLMS, multiple times. Hence the conclusion that LLM improvement has slowed down, if not stagnated entirely, and that we…

From TFA:

“ChatGPT came up with an idea which is original and clever. It is the sort of idea I would be very proud to come up with after a week or two of pondering, and it took ChatGPT less than an hour to find and prove”

Re: A recent experience with ChatGPT 5.5 Pro

#238

Earlier quoted context omitted.

In what sense are the models flatlining?

In the sense that the incremental improvements in capabilities that we've been seeing in recent models seem to taking exponentially growing amounts of compute to achieve.

But they don't?

Mythos is a 10T model. Opus is a 5T model.

That's not an exponentially growing amount of compute but it is achieving exponential improvements (eg from Mozilla: https://blog.mozilla.org/en/privacy-security/ai-security-zer... )

Re: A recent experience with ChatGPT 5.5 Pro

#239

I am a physics professor and often use Gemini to check my papers. It is a formidable tool: it was able to find a clerical error (a missing imaginary unit in a complex mathematical expression) I was not able to find for days, and it often underlines connections between concepts and ideas that I overlooked. However, it often makes conceptual errors that I can spot only because I have good knowledge of the topic I am di…

intern that never sleeps

Re: A recent experience with ChatGPT 5.5 Pro

#240

I am a physics professor and often use Gemini to check my papers. It is a formidable tool: it was able to find a clerical error (a missing imaginary unit in a complex mathematical expression) I was not able to find for days, and it often underlines connections between concepts and ideas that I overlooked. However, it often makes conceptual errors that I can spot only because I have good knowledge of the topic I am di…

Any experience with NotebookLM?

Mine has been epically bad.

Post reply on HN