Live data from Hacker News

GPT 5.6 Sol is the best "vision" model OpenAI ever released

blog.roboflow.com

31–40 of 194 posts

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#31
post #18

Earlier quoted context omitted.

Assessing the subjective quality of a thing is in my experience one of the worst ways to use any LLM.

anthropic frontend-design skill does a great job with it.

Have you actually read the frontend design skill? It’s placebo at best. Very short and barely focused on design: https://github.com/anthropics/skills/blob/main/skills/fronte...

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#32

I understand why you would like to use an LLM for vision. I do it myself often enough. I don't understand however, why the pill detection and counting is included in this benchmark. That is a task which you would perform with OpenCV right? In my personal mini benchmark minicpm-v-4.6 scores amazingly well. Its a 0.8B model which runs fine on many consumer hardware.

Generating datasets to train more efficient models is a common use case for VLMs, especially frontier ones. It makes it much cheaper to create that initial dataset and you can abuse the nondeterminism of LLMs to identify data for human review (if they don’t converge, escalate to a human).

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#33

I didn't expect Gemini 3.5 Flash to top basically every metric in this article.

Same. I scrolled back up to see if I read the title correctly. It's important to note that it is the best... OpenAI released. Not the best overall.

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#36
post #18

Earlier quoted context omitted.

Assessing the subjective quality of a thing is in my experience one of the worst ways to use any LLM.

anthropic frontend-design skill does a great job with it.

My exposure to Claude-produced UIs is limited, but I have started to notice certain design trends they tend to have in-common, which might be becoming hallmarks of AI-produced UIs - the same way we've started noticing the clichés of low-effort LLM-generated text.

FWIW, the summary-description[1] of "frontend-design"[2] gives me a few things to pick at:

> create polished code

Methinks only if you're using it with a very popular framework like React. What happens if you ask Claude to make the UI in WinForms or MFC?

> high-impact animations

That's bad UX 101 right there: animations in a UI exist as an affordance to the user, and never for its own sake (e.g. macOS's "genie" animation when you minimize a window to the dock exists so the user knows where they can restore the window from). The only people who actually want "high impact animations" in software are salespeople who want something for demo purposes.

> generic system fonts, predictable purple gradients, and cookie-cutter components.

This screams wanting to be different for the sake of standing-out, not because it results in a better software product; users benefit when their software fits-in with platform conventions: if you refuse to use a stock checkbox or drop-down and instead use your own entirely custom component solely for aesthetic reasons then you are producing worse software. There's nothing wrong with system-fonts, but your site will look ugly after your third-party font-host CDN shuts-down and turns into a walking CSRF factory.

> thoughtful typography with unexpected font pairings

The above fragment set my alarm-bells off. Yikes.

> scroll-triggered interactions

Not every web-page should be an Apple.com product brochure page. This is also a fantastic way to make your webpage horribly inaccessible.

------

The SKILL.md itself[3] grinds my gears too:

> Approach this as the design lead at a small studio known for giving every client a visual identity that could not be mistaken for anyone else's.

Claude has no way of knowing what designs are actually unique or not...

> For web designs, the hero is a thesis. Open with the most characteristic thing in the subject's world, in whatever form makes sense for it: a headline, an image, an animation, a live demo, an interactive moment

...this is exactly what everyone else's web-pages look like!

> For calibration: AI-generated design right now clusters around three looks: (1) a warm cream background (near #F4F1EA) with a high-contrast serif display and a terracotta accent; (2) a near-black background with a single bright acid-green or vermilion accent; (3) a broadsheet-style layout with hairline rules, zero border-radius, and dense newspaper-like columns

...I called this out weeks ago[4], lol.

and I could go on. This is all quite painful to read.

------

[1] https://claude.com/plugins/frontend-design

[2] https://github.com/anthropics/claude-plugins-official/tree/m...

[3] https://github.com/anthropics/claude-plugins-official/blob/2...

[4] https://news.ycombinator.com/item?id=49187385

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#38
One of my friends (and BIL) own an architecture firm. They use AI to generate and quickly update renderings but they run into the equivalent of the 6 fingered hand problem. I sent him this article I wonder if the updated models can catch and fix mistakes made by previous models.

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#39
post #5

For the last 2 weeks I've been trying to get Codex to "outpaint" a wonderful image it generated as placeholder art for a level background. After I increased the game's resolution, I asked it to increase the image's size while keeping the same scale and existing content, and gosh, it constantly keeps getting something wrong no matter what I tell it, even on Sol Max with the $100 Pro subscription. An organically-grown…

I'm unsure why you're using an LLM to generate images. Don't we already have models (some made by the same company) that do this?

Re: GPT 5.6 Sol is the best "vision" model OpenAI ever released

#40
post #31
post #18

Earlier quoted context omitted.

anthropic frontend-design skill does a great job with it.

Have you actually read the frontend design skill? It’s placebo at best. Very short and barely focused on design: https://github.com/anthropics/skills/blob/main/skills/fronte...

What an annoying time for GitHub to go down.
Post reply on HN