Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-6 Astra on OpenRouter

openrouter.ai

Post reply on HN
Print view View original

151–160 of 256 posts

Re: GPT-6 Astra on OpenRouter

#151

Post by sehugg »

kzrdude wrote: post #144
embedding-shape wrote: post #26

Earlier quoted context omitted.

At the bottom it says "Score 98.58", what measure is used for this score? It's kind of horrible, the perspective is all off (legs of the table makes that very obvious), the mouse/hamster has two mouths, a stub for a right paw, looks like left hand holds a melon on a stick or something, and there are pluses in the background for some reason. Not sure it'd call it "close to perfect" which the score seems to want to ind…

And not to mention, the hamster is standing at the wrong end of the table.

And also the hamster has two mouths

Re: GPT-6 Astra on OpenRouter

#152

Post by XCSme »

embedding-shape wrote: post #148
XCSme wrote: post #38

Earlier quoted context omitted.

I've replaced "Score" there with model ranking, to reduce confusion, thanks for the feedback!

Now I'm wondering why it's ranked #4 instead, not sure this reduced confusion :P What panel of judges are you using for scoring/ranking this? Seems subjective enough to not be able to be ranked/scored at all

Yeah, ranking is for entire model, not only SVG generation. Maybe I remove it entirely and add generation date instead.

I was thinking to manually grade/rank the SVGs, but I decided against it, as it is indeed subjective.

I was thinking it could have at least a simple objective check (hamster doesn't have extra or missing parts, table has 2 sides, and net is in the middle, etc.).

Re: GPT-6 Astra on OpenRouter

#153

Post by stymaar »

dector wrote: post #100
simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

Btw, they had 3D pelican-on-the-bicycle easter egg in one of the promo videos: https://youtu.be/bOC3DisEOfg?t=117 so I'm pretty sure that they spent some small amount of resources to train the model to produce good svg version as well. :D

When you see how good the output of the Luna model without reasoning is compared to SotA just a year and a half ago, it's pretty clear that it's been trained on explicitly.

Re: GPT-6 Astra on OpenRouter

#154

Post by r_lee »

jiggawatts wrote: post #120
r_lee wrote: post #4

is Azure for this actually ZDR?

It cracks me up that you have to ask in a public forum because the vendors purposefully obscure this critical information. The only reason most of my customers would use Azure Foundry instead of OpenAI directly is the ZDR assurance but it is so incredibly difficult to extract out of their model menu. There is no trivial way to block non-ZDR models either so every customer has to “vet” and individually approve models.…

from my understanding, ZDR for this is for vetted customers only + their whole "privacy preserving abuse monitoring" or whatever is active

but again, seems like there's no word from Azure if this applies to them.

very confusing.

Re: GPT-6 Astra on OpenRouter

#155

Post by [deleted] »

simonw wrote: post #96
steve-atx-7600 wrote: post #77

Earlier quoted context omitted.

You would not expect the developers of the model to optimize for a well known benchmark?

Here's 'Generate an SVG of a ring-tailed lemur riding an electric scooter' at reasoning level max: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... Quote from the thinking trace: > I’m thinking about how a helmet would obscure lemur ears, but using an electric scooter helmet seems responsible. It's pretty solid - face is a little wonky but excellent tail and scooter.

[deleted]

Re: GPT-6 Astra on OpenRouter

#156

Post by slopinthebag »

simianwords wrote: post #126
redox99 wrote: post #116

Earlier quoted context omitted.

It is (uses way less tokens)

No it isn't cheaper, any source for task vs price comparison to Sol? Edit: GPT-6 Astra (low): 57 Intelligence Index, $7.70/M tokens GPT-5.6 Sol (high): 57 Intelligence Index, $3.08/M tokens So for the same measured intelligence, Sol costs only 40% as much — i.e. ~60% cheaper, while Astra is ~2.5× more expensive. Why is the burden of proof on me tho!?

they said opus, not sol, it's cheaper than opus by almost half at max.

astra high is also 3x cheaper than opus max at basically the same intelligence.

astra high is also about as expensive as sol max while being more intelligent.

astra medium is cheaper than sol max while also being cheaper and roughly same intelligence.

im going to replace my sol usage with astra high/medium i think

caveat: benchmarks are really fuzzy with llms

Re: GPT-6 Astra on OpenRouter

#157

Post by justinbaker84 »

simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

Your comparison grid is one of the most useful comparison grids I have ever seen in terms of measuring AI.

It feels silly to say that about making a pelican image but it really shows the difference in output and cost in an easy to understand way.

Re: GPT-6 Astra on OpenRouter

#158

Post by EugeneOZ »

simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

I love Astra pelicans! Awesome results!

Re: GPT-6 Astra on OpenRouter

#159

Post by stymaar »

simonw wrote: post #96
steve-atx-7600 wrote: post #77

Earlier quoted context omitted.

You would not expect the developers of the model to optimize for a well known benchmark?

Here's 'Generate an SVG of a ring-tailed lemur riding an electric scooter' at reasoning level max: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... Quote from the thinking trace: > I’m thinking about how a helmet would obscure lemur ears, but using an electric scooter helmet seems responsible. It's pretty solid - face is a little wonky but excellent tail and scooter.

What if you asked a front/rear/top-side view of the scene (pelican or lemur)?

Re: GPT-6 Astra on OpenRouter

#160

Post by kolinko »

copperx wrote: post #102
jjcm wrote: post #90

It's ability to handle non-90 degree cutouts and shapes for web dev is one of the best I've seen. The vision model on this is VERY capable. Here's an image design source of truth: https://image.non.io/78f4cd8b-2560-4643-9a51-96a89171f994.we... And here's the page it build from it: https://image.non.io/e7d3a9e5-f9df-4fd8-b79f-1f90280f978f.we... Note the flowing svg lines, and how accurately it recreated them. Here's O…

> That site build cost $24 - extremely non-trivial for a simple frontend. I would say that $24 is trivial IF that's the final design. The truth is that the cost doesn't leave much room for error or experimentation.

Wdym no room for error or experimation? Changes are even cheaper, and in my experience they are faster and way cheaper with models than with designers.
Post reply on HN