Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-6 Astra on OpenRouter

openrouter.ai

Post reply on HN
Print view View original

131–140 of 255 posts

Re: GPT-6 Astra on OpenRouter

#131

Post by dgellow »

Kranar wrote: post #83
steve-atx-7600 wrote: post #77

Earlier quoted context omitted.

You would not expect the developers of the model to optimize for a well known benchmark?

What is this supposed to mean exactly? Do you think there are developers at OpenAI or Anthropic whose job is to train these state of the art models to draw pelicans riding bicycles? Like how exactly do you expect them to be doing that anyways? Hiring graphic artists to create SVGs of bike riding pelicans and feeding thousands of them into the model's training set?

> Do you think there are developers at OpenAI or Anthropic whose job is to train these state of the art models to draw pelicans riding bicycles?

Yes

Re: GPT-6 Astra on OpenRouter

#132

Post by XCSme »

redox99 wrote: post #95
appplication wrote: post #50

Earlier quoted context omitted.

Sure, it is a bit cartoonish but it’s relatively impressive. I do wonder what you would get if you asked for photorealism

The problem is not photorealism. The SVG is outright dumb, its on the wrong side of the table, the table has fucked up geometry (its tilted) and many more minor flaws.

That's true, if it really "knows" stuff, a bit weird to have basic flaws like 2 mouths, and sitting on the side...

Re: GPT-6 Astra on OpenRouter

#133

Post by dgellow »

wickedsight wrote: post #129
simianwords wrote: post #126

Earlier quoted context omitted.

No it isn't cheaper, any source for task vs price comparison to Sol? Edit: GPT-6 Astra (low): 57 Intelligence Index, $7.70/M tokens GPT-5.6 Sol (high): 57 Intelligence Index, $3.08/M tokens So for the same measured intelligence, Sol costs only 40% as much — i.e. ~60% cheaper, while Astra is ~2.5× more expensive. Why is the burden of proof on me tho!?

This is the second comment I see where you write "no it isn't", without providing a source for your statement. Then you follow it by asking for a source. So is there a source you can provide to back up your statement?

It’s supposed to work the other way, if you make a positive claim that it is cheaper, where is your proof?

Re: GPT-6 Astra on OpenRouter

#134

Post by gentlewater »

MisterMunchkin wrote: post #104

$10/$50 is incredibly expensive compared to Chinese models which are cents. I think they’re really going to struggle selling these models long-term. My company is already massively cutting down on access because they’ve realised most people don’t actually produce any value using it. All the tokenmaxers have ruined it for the rest of us now that accounting have seen the costs.

Not really comparable IMO. Astra and Fable are not the every day workhorse you reach for to do basic tasks (unless your company has fuck you-money), they’re the tool you break out when you need the absolute strongest performance. There are plenty of tasks where finding and fixing one or two extra edge cases saves the business a lot of money, even if the cost is high. The best example would be scanning for vulnerabilities, if these models weren’t kneecapped in that area.

Re: GPT-6 Astra on OpenRouter

#136

Post by bahmboo »

Gander5739 wrote: post #124
bahmboo wrote: post #94

Earlier quoted context omitted.

Would be great to spend some money (other people's money) on paying some illustrators and artists to do the same for comparison. It could be straight images converted to SVG or direct vector graphics.

Doesn't that somewhat miss the point? The models can't see and check their work, for instance.

I'm not clear what you are saying. I am curious about what humans can do in the same context. It's becoming a standard I think for some tasks. E.g. how does a Gen AI stack up against a human in quality and "cost". Perhaps I'm missing what you are asking.

Re: GPT-6 Astra on OpenRouter

#137

Post by CapsAdmin »

mydreamof wrote: post #115
jjcm wrote: post #90

It's ability to handle non-90 degree cutouts and shapes for web dev is one of the best I've seen. The vision model on this is VERY capable. Here's an image design source of truth: https://image.non.io/78f4cd8b-2560-4643-9a51-96a89171f994.we... And here's the page it build from it: https://image.non.io/e7d3a9e5-f9df-4fd8-b79f-1f90280f978f.we... Note the flowing svg lines, and how accurately it recreated them. Here's O…

I don't get it. For me it seems Opus was more accurate in terms of for example this small building in the right down corner

I would say opus was in some ways more accurate, but missed the higher level curvature feel of the site that astra picked up on.

It sounds completely trivial and likely I'm wrong here, but could it be that opus saw the reference image squished? That might explain the sharper horizontal curvature

Re: GPT-6 Astra on OpenRouter

#138

Post by pointitkememe »

simonw wrote: post #96
steve-atx-7600 wrote: post #77

Earlier quoted context omitted.

You would not expect the developers of the model to optimize for a well known benchmark?

Here's 'Generate an SVG of a ring-tailed lemur riding an electric scooter' at reasoning level max: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... Quote from the thinking trace: > I’m thinking about how a helmet would obscure lemur ears, but using an electric scooter helmet seems responsible. It's pretty solid - face is a little wonky but excellent tail and scooter.

[flagged]

Re: GPT-6 Astra on OpenRouter

#139

Post by mawadev »

viccis wrote: post #111
XCSme wrote: post #22

That's some crazy SVG generation: https://aibenchy.com/compare/openai-gpt-6-astra-high/google-... It took a while to test it, initially OpenRouter was giving Not Found errors for this model ID.

>AGI >Playing ping pong from the side of the table I think marketing might be getting a bit absurd at this point

I must live in a different world or it feels like I'm reading LLM generated comments, but who exactly is falling for this marketing?

I even keep seeing obvious stealth marketing like this: " and how do I use it with in "

Re: GPT-6 Astra on OpenRouter

#140

Post by JumpCrisscross »

copperx wrote: post #102
jjcm wrote: post #90

It's ability to handle non-90 degree cutouts and shapes for web dev is one of the best I've seen. The vision model on this is VERY capable. Here's an image design source of truth: https://image.non.io/78f4cd8b-2560-4643-9a51-96a89171f994.we... And here's the page it build from it: https://image.non.io/e7d3a9e5-f9df-4fd8-b79f-1f90280f978f.we... Note the flowing svg lines, and how accurately it recreated them. Here's O…

> That site build cost $24 - extremely non-trivial for a simple frontend. I would say that $24 is trivial IF that's the final design. The truth is that the cost doesn't leave much room for error or experimentation.

> truth is that the cost doesn't leave much room for error or experimentation

Compared to what?

Post reply on HN