Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5.2

openai.com

Post reply on HN
Print view View original

921–930 of 1001 posts

Re: GPT-5.2

#921

Post by BrtByte »

doctoboggan wrote: post #12

This seems like another "better vibes" release. With the number of benchmarks exploding, random luck means you can almost always find a couple showing what you want to show. I didn't see much concrete evidence this was noticeably better than 5.1 (or even 5.0). Being a point release though I guess that's fair. I suspect there is also some decent optimizations on the backend that make it cheaper and faster for OpenAI t…

At this point the benchmark soup is so dense that it's hard to tell signal from selective framing

Re: GPT-5.2

#923

Post by tylerrobinson »

throwaway2037 wrote: post #858

Somewhat tangential: The second link says "System card": https://cdn.openai.com/pdf/3a4153c8-c748-4b71-8e31-aecbde944... Does that term have special meaning in the AI/LLM world? I never heard it before. I Google'd the term "System Card LLM" and got a bunch of hits. I am so surprised that I never saw the term used here in HN before. Also, the layout looks exactly like a scientific paper written in LaTeX. Who is the ex…

The major model providers use system cards as a sort of self attestation document like a nutrition label. It’s been around for a couple years.

Re: GPT-5.2

#924

Post by johnwheeler »

yard2010 wrote: post #770
johnwheeler wrote: post #474

Earlier quoted context omitted.

Oh and you guys don't mislead people ever. Your management is just completely trustworthy, and I'm sure all you guys are too. Give me a break, man. If I were you, I would jump ship or you're going to be like a Theranos employee on LinkedIn.

Hey no need to personally attack anyone. A bad organization can still consist good people.

I disagree. I think the whole organization is egregious and full of Sam Altman sycophants that are causing a real and serious harm to our society. Should we not personally attack the Nazis either? These people are literally pushing for a society where you're at a complete disadvantage. And they're betting on it. They're banking on it.

Re: GPT-5.2

#925

Post by wahnfrieden »

manmal wrote: post #727
wahnfrieden wrote: post #671

Earlier quoted context omitted.

5.1 Pro is great

I struggle to see where Pro is better than 5.x with Thinking. Actually prefer the latter.

Many problems where latter spins its wheel and Pro gets it in one go, for me. You need to give Pro full files as context and you need to fit within its ~60k (I forget exactly) silent context window if using via ChatGPT. Don't have it make edits directly, have it give the execution plan back to Codex

Re: GPT-5.2

#926

Post by LEDThereBeLight »

xwolfi wrote: post #806
khafra wrote: post #715

Earlier quoted context omitted.

LLMs are an especially tough case, because the field of AI had to spend sixty years telling people that real AI was nothing like what you saw in the comics and movies; and now we have real AI that presents pretty much exactly like what you used to see in the comics and movies.

But it cannot think or mean anything, it's just a clever parrot so it's a bit weird. I guess uncanny is the word. I use it as google now, like just to search stuff that are hard to express with keywords.

Try asking it a question you know has never been asked before. Is it parroting?

Re: GPT-5.2

#927

Post by tsunamifury »

EastLondonCoder wrote: post #856
biofox wrote: post #830

Earlier quoted context omitted.

I ask for confidence scores in my custom instructions / prompts, and LLMs do surprisingly well at estimating their own knowledge most of the time.

I’m with the people pushing back on the “confidence scores” framing, but I think the deeper issue is that we’re still stuck in the wrong mental model. It’s tempting to think of a language model as a shallow search engine that happens to output text, but that metaphor doesn’t actually match what’s happening under the hood. A model doesn’t “know” facts or measure uncertainty in a Bayesian sense. All it really does is t…

Hallucinations are a feature of reality that LLMs have inherited.

It’s amazing that experts like yourself who have a good grasp of the manifold MoE configuration don’t get that.

LLMs much like humans weight high dimensionality across the entire model then manifold then string together an attentive answer best weighted.

Just like your doctor occasionally giving you wrong advice too quickly so does this sometimes either get confused by lighting up too much of the manifold or having insufficient expertise.

Re: GPT-5.2

#928

Post by YouAreWRONGtoo »

AstroBen wrote: post #694
namesbc wrote: post #685

So the rosy biased estimate is OpenAI is saving 1 hour of work per day, so 5 hours total per-work week and 20 hours total per-month. With a subsidized cost of $200/month for OpenAI it would be cheaper to hirer a part-time minimum wage worker than it would be to contract with OpenAI. And that is the rosiest estimate OpenAI has.

What people here forget is coding is a tiny minority of the actual usage. ~5% if I remember correctly? Their best market might just be as a better Google with ads

[dead]

Re: GPT-5.2

#929

Post by tsunamifury »

balder1991 wrote: post #888
conception wrote: post #877

Earlier quoted context omitted.

You need to change the temperature to 0 and tune your prompts for automated workflows.

It doesn’t really solve it as a slight shift in the prompt can have totally unpredictable results anyway. And if your prompt is always exactly the same, you’d just cache it and bypass the LLM anyway. What would really be useful is a very similar prompt should always give a very very similar result.

That’s a way different problem my guy.
Post reply on HN