I wonder what about UI review, which model is the best?
GPT 5.6 Sol is the best "vision" model OpenAI ever released
181–190 of 194 posts
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#182Earlier quoted context omitted.
Hi, I’m the author of this blog post. I wrote it about 4 weeks ago, and the VLM world is moving so fast that it’s already kinda outdated. I think Gemini 3.7 Flash might be a better choice now, especially when you factor in the price. Here’s a comparison of the best low-cost models I put together last week. What’s crazy is that Gemini 3.7 Flash is now 50% off on OpenRouter, and this chart doesn’t even account for that…
Curious why you didn't try Gemini 3 pro? That is the model I've been using for OCR entry of handwritten datasheets (JPGS of datasheets, structured JSON output). At my scale, the cost of 3 pro is basically not an issue, but if there are improvements in quality, I'd definitely be willing to explore other models
[dead]
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#183The summary "There are still clear limits. Gemini 3.5 Flash remains a better practical choice [than GPT 5.6 Sol] for high-volume detection and counting in our benchmark, especially at its price." seems rather understated ! GPT 5.6 Sol was outperformed on all benchmarks by Gemini 3.5 Flash, apart from a single exception (OCR) where Fable was the winner. Gemini 3.5 Flash not only outperformed GPT 5.6 Sol, but did so at…
Hi, I’m the author of this blog post. I wrote it about 4 weeks ago, and the VLM world is moving so fast that it’s already kinda outdated. I think Gemini 3.7 Flash might be a better choice now, especially when you factor in the price. Here’s a comparison of the best low-cost models I put together last week. What’s crazy is that Gemini 3.7 Flash is now 50% off on OpenRouter, and this chart doesn’t even account for that…
[flagged]
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#184The prompt sensitivity is fascinating. A simple coordinate-format change shifting detection performance this much shows how much interface design still matters.
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#185Earlier quoted context omitted.
Assessing the subjective quality of a thing is in my experience one of the worst ways to use any LLM.
i'd say this is something that has gotten orders of magnitude better with recent releases than it used to be, fwiw
When asked to produce a thing, the output has a much better baseline of quality. But when you ask it to evaluate the quality of a thing, how do you evaluate the quality of its response, which is necessarily subjective and not quantifiable? How can a thing which has no experience of friction be said to subjectively evaluate quality?
Either you are yourself already a better judge of the thing’s quality, in which case the response can be of no use to you, or you are a poor judge of the thing’s quality, in which case you will be blind to the flaws in the synthesized opinion handed back to you.
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#186[flagged]
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#187Earlier quoted context omitted.
3.1 Pro is not deprecated!
https://ai.google.dev/gemini-api/docs/deprecations That link shows 3.1 pro listed as deprecated with no replacement model.
You are misreading that link. That's a list of all their models.
Just like 3.7 Flash, 3.1 Pro says "No shutdown date announced."
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#188Earlier quoted context omitted.
Of course. It’s OK, but it tends to generate very cliched “AI” UIs with little originality. Despite the skill spending a lot of time coaching the model into avoiding that!
> UIs with little originality Sounds like the kind of UI I like. (Take me back to Windows XP...)
I mean they all look like generic, annoying SaaS landing pages/overwrought dashboards, not that they’re simple and functional.
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#189Do you think we’re getting closer to models that actually understand what they’re seeing, or are they just getting really good at recognizing patterns?
"yes" but that's a philosophical question. I think they're getting better at "early fusion" IE, training the model that "apple" and these visual tokens are the the same concept, but LLMs are fundamentally a pattern matching machine so even with perfect fusion I personally wouldn't call it understanding.
Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released
#190Earlier quoted context omitted.
https://ai.google.dev/gemini-api/docs/deprecations That link shows 3.1 pro listed as deprecated with no replacement model.
No, that's the "preview" version (gemini-3.1-pro-preview) aka the beta/early version before the official release of 3.1 Pro.
[deleted]