Live data from Hacker News

GPT-5.2

openai.com

891–900 of 1001 posts

Re: GPT-5.2

#891
post #750

Is it me, or did it still get at least three placements of components (RAM and PCIe slots, plus it's DisplayPort and not HDMI) in the motherboard image[0] completely wrong? Why would they use that as a promotional image? 0: https://images.ctfassets.net/kftzwdyauwt9/6lyujQxhZDnOMruN3f...

And here is Gemini 3: https://media.licdn.com/dms/image/v2/D5610AQH7v9MtrZxxug/ima...

When OpenAI Marketing Material is actually showing how far Gemini3 is ahead...

Re: GPT-5.2

#892
post #765

In my experience, the best models are already nearly as good as you can be for a large fraction of what I personally use them for, which is basically as a more efficient search engine. The thing that would now make the biggest difference isn't "more intelligence", whatever that might mean, but better grounding. It's still a big issue that the models will make up plausible sounding but wrong or misleading explanations…

I agree, but the question is how better grounding can be achieved without a major research breakthrough. I believe the real issue is that LLMs are still so bad at reasoning. In my experience, the worst hallucinations occur where only handful of sources exist for some set of facts (e.g laws of small countries or descriptions of niche products). LLMs know these sources and they refer to them but they are interpreting t…

Anything that is very specific has the same problem, because LLMs can’t have the same representation of all topics in the training. It doesn’t have to be too niche, just specific enough for it to start to fabricate it.

One of these days I had a doubt about something related to how pointers work in Swift and I tried discussing with ChatGPT (don’t remember exactly what, but it was purely intellectual curiosity). It gave me a lot of explanations that seemed correct, but being skeptical and started pushing it for ways to confirm what it was saying and eventually realized it was all bullshit.

This kind of thing makes me basically wary of using LLMs for anything that isn’t brainstorming, because anything that requires knowing information that isn’t easily/plentifully found online will likely be incorrect or have sprinkles of incorrect all over the explanations.

Re: GPT-5.2

#893

Earlier quoted context omitted.

That’s not a very useful observation though is it? The purpose of mechanisation is to standardise and over the long term reduce errors to zero. Otoh “The final truth is there is no truth”

A lot of mechanisation, especially in the modern world, is not deterministic and is not always 100% right; it's a fundamental "physics at scale" issue, not something new to LLMs. I think what happened when they first appeared was that people immediately clung to a superintelligence-type AI idea of what LLMs were supposed to do, then realised that's not what they are, then kept going and swung all the way over to "the…

That's why I said tend to zero error. I'm a Six Sigma guy. We take accurate over precise.

Re: GPT-5.2

#894
post #886
post #560

Earlier quoted context omitted.

Do people other than Elon fans use grok? Honest question. I've never tried it.

it's the biggest model on OpenRouter, even if you exclude free tier usage https://openrouter.ai/state-of-ai

Roleplay is the largest use-case on openrouter.

Re: GPT-5.2

#895
post #732

Earlier quoted context omitted.

No-one should have the expectation LLMs are giving correct answers 100% of the time. It's inherent to the tech for them to be confidently wrong Code needs to be checked References need to be checked Any facts or claims need to be checked

"confidently" is a feature selected in the system prompt. As a user you can influence that behavior.

No it isn't. It isn't intelligent, it's a statistical engine. Telling it to be confident or less confident doesn't make it apply confidence appropriately. It's all a facade

Re: GPT-5.2

#896

Earlier quoted context omitted.

No, it's not the same. Search results send/show you one or more specific pages/websites. And each website has a different trust factor. Yes, plenty of people repeat things they "read on the Internet" as truths, but it's easy to debunk some of them just based on the site reputation. With AI responses, the reputation is shared with the good answers as well, because they do give good answers most of the time, but also h…

Community notes on X seems to be one of the highest profile recent experiments trying to address this issue

My attempt: https://www.cleverthinkingsoftware.com/truth-or-extinction/

Re: GPT-5.2

#897

For the first time, I've actually hidden an AI story on HN. I can't even anymore. Sorry this is not going anywhere.

How this is different to any other post announcing an incremental improvement in an app or service?

It’s a little different. Most of these improvements are just more training hours and better weights. Even if it’s about actual improvement in trining algorithm or other software tweaks they’re not open source and hence other than “look how marginally nicer the chat bot responds now” the post doesn’t provide value.

Re: GPT-5.2

#898

Again I just tap the sign. All of your benchmarks mean nothing to me until you include Claude Sonnet on them. In my experience, GPT hasn’t been able to compete with Claude in years for the daily “economically valuable” tasks I work on.

Claude is pretty trash for anything besides coding

Yeah, but that is the whole point of Claude. And that's why we are interested in the comparison.

Re: GPT-5.2

#899

I feel there is a point when all these benchmarks are meaningless. What I care about beyond decent performance is the user experience. There I have grudges with every single platform and the one thing keeping me as a paid ChatGPT subscriber is the ability to sort chats in "projects" with associated files (hello Google, please wake up to basic user-friendly organisation!) But all of them * Lie far too often with confi…

I'm always impressed how fast people get used to new things. couple of years ago something like chatgpt was completely impossible, and now people complain it something's does mit do what you told it to and sometimes lies. (not saying your points are not valid or you should not raise them) Some of the points are just not fixable at this point due to tech limitations. A language model currently simply has no way to giv…

Your point would stand if the entire economy wasn't shifted around this product and employees weren't being told to use it or lose their jobs.

Re: GPT-5.2

#900
post #765

In my experience, the best models are already nearly as good as you can be for a large fraction of what I personally use them for, which is basically as a more efficient search engine. The thing that would now make the biggest difference isn't "more intelligence", whatever that might mean, but better grounding. It's still a big issue that the models will make up plausible sounding but wrong or misleading explanations…

My biggest problem with LLM's at this point is that they produce different and inconsistent results or behave differently, given the same prompt. The better grounding would be amazing at this point. I want to give an LLM the same prompt on different days and I want to be able to trust that it will do the same thing as yesterday. Currently they misbehave multiple times a week and I have to manually steer it a bit whic…

It sounds like you have dug into this problem with some depth so I would love to hear more. When you've tried to automate things, I'm guessing you've got a template and then some data and then the same or similar input gives totally different results? What details about how different the results are can you share? Are you asking for eg JSON output and it totally isn't, or is it a more subtle difference perhaps?
Post reply on HN