Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT 5.6 Sol is the best "vision" model OpenAI ever released

blog.roboflow.com

Post reply on HN
Print view View original

61–70 of 194 posts

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#61

Post by ParanoidShroom »

I run the free service https://countrx.app/ so i have some idea what goes into counting.

The performance as a general model is indeed really impressive and i think they might actually win compared to fine tuned models.

Their feedback loop of training on user data is incredibly strong. I've learned that lots of accuracy results depends on threshold configs, which llms should be able to dynamically set.

Or the future will develop in llms using fine-tuned models as tools? Inference cost and speed does still seem to be below user expectations.

But for being able to one shot with this accuracy... IMPRESSIVE

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#62

Post by Razengan »

thatcat wrote: post #8
Razengan wrote: post #5

For the last 2 weeks I've been trying to get Codex to "outpaint" a wonderful image it generated as placeholder art for a level background. After I increased the game's resolution, I asked it to increase the image's size while keeping the same scale and existing content, and gosh, it constantly keeps getting something wrong no matter what I tell it, even on Sol Max with the $100 Pro subscription. An organically-grown…

did you try segmenting it first?

At first I intended to create a tileset and asked it for several variations of what a hypothetical tilemap created from the planned tileset would look like.

The previews it generated were amazing but wouldn't really be possible as a grid-based tilemap, with lots of clusters and overlaps of elements of varying sizes.

So I just decided to use the preview as a static scrolling background, but it's been a pain to get it to add more content around the edges that still tiles with the existing image at the same scale.

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#63

Post by bicx »

MrBuddyCasino wrote: post #53
HarHarVeryFunny wrote: post #45

The summary "There are still clear limits. Gemini 3.5 Flash remains a better practical choice [than GPT 5.6 Sol] for high-volume detection and counting in our benchmark, especially at its price." seems rather understated ! GPT 5.6 Sol was outperformed on all benchmarks by Gemini 3.5 Flash, apart from a single exception (OCR) where Fable was the winner. Gemini 3.5 Flash not only outperformed GPT 5.6 Sol, but did so at…

Yeah I was thinking about giving Luna a go with my PDF data extraction, but I think I‘ll stay on Gemini. It does a very good job.

Gemini is still my top choice within production software for typical data extraction from unstructured data. Gemini Flash Lite feels like a cheat code for speed, and it's really cheap.

Some other Chinese models are also fast and cheap, but a harder sell in a U.S. production environment.

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#64

Post by rib3ye »

rafram wrote: post #31
rib3ye wrote: post #18

Earlier quoted context omitted.

anthropic frontend-design skill does a great job with it.

Have you actually read the frontend design skill? It’s placebo at best. Very short and barely focused on design: https://github.com/anthropics/skills/blob/main/skills/fronte...

Have you actually tried using it?

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#66

Post by stavros »

Mashimo wrote: post #46
chasd00 wrote: post #38

One of my friends (and BIL) own an architecture firm. They use AI to generate and quickly update renderings but they run into the equivalent of the 6 fingered hand problem. I sent him this article I wonder if the updated models can catch and fix mistakes made by previous models.

This article is about vision, not image output.

Hence the "catch and fix mistakes" part.

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#67

Post by ImageXav »

iamleppert wrote: post #30

Where are the Qwen benchmarks in this? I would be more interesting to see how Qwen performs.

Me too. This is an interesting comparison but in my experience Qwen and Gemini have typically been the top contenders for image related tasks. For that reason it would be great to have the comparison here, as I'm not surprised by Gemini's dominance over the other models.

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#69

Post by sarreph »

DaiPlusPlus wrote: post #19
sarreph wrote: post #10

Earlier quoted context omitted.

If you're doing any kind of inference that is multi-modal and non-factual, opinions and biases will affect any kind of assessment of a visual that you provide to a model. For example, a UI / UX professional being asked to appraise a website screenshot may determine that the image in question has "desirable" traits which are inherently not deterministically measurable. Such as, if the interface elements have strong in…

> if the interface elements have strong information hierarchy ...but that's an example of a UX/usability matter that can be assessed objectively and non-subjectively.

I disagree.

Is 16 px or 14 px a better font-size value for a subheading, in a hypothetical layout? Immediately that kind of decision, where both options are objectively good for 12 px paragraph text, suddenly becomes an issue of taste that cannot be evaluated crudely by an algorithm.

Post reply on HN