Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-6 Astra on OpenRouter

openrouter.ai

Post reply on HN
Print view View original

31–40 of 255 posts

Re: GPT-6 Astra on OpenRouter

#31

Post by XCSme »

embedding-shape wrote: post #26
XCSme wrote: post #22

That's some crazy SVG generation: https://aibenchy.com/compare/openai-gpt-6-astra-high/google-... It took a while to test it, initially OpenRouter was giving Not Found errors for this model ID.

At the bottom it says "Score 98.58", what measure is used for this score? It's kind of horrible, the perspective is all off (legs of the table makes that very obvious), the mouse/hamster has two mouths, a stub for a right paw, looks like left hand holds a melon on a stick or something, and there are pluses in the background for some reason. Not sure it'd call it "close to perfect" which the score seems to want to ind…

Yeah, that's confusing, the score is for the entire benchmark, not for SVG generation only.

Good point about the mouths, I just noticed, lol

Imo, it's still better than most models, I personally like the stylized perspective.

You can view here all generations for all models: https://aibenchy.com/showcase/

Re: GPT-6 Astra on OpenRouter

#32

Post by XCSme »

embedding-shape wrote: post #26
XCSme wrote: post #22

That's some crazy SVG generation: https://aibenchy.com/compare/openai-gpt-6-astra-high/google-... It took a while to test it, initially OpenRouter was giving Not Found errors for this model ID.

At the bottom it says "Score 98.58", what measure is used for this score? It's kind of horrible, the perspective is all off (legs of the table makes that very obvious), the mouse/hamster has two mouths, a stub for a right paw, looks like left hand holds a melon on a stick or something, and there are pluses in the background for some reason. Not sure it'd call it "close to perfect" which the score seems to want to ind…

Do you prefer the fable one?

It's more "correct" but looks a lot worse in my opinion:

https://aibenchy.com/compare/openai-gpt-6-astra-high/google-...

Re: GPT-6 Astra on OpenRouter

#33

Post by satvikpendem »

leoqa wrote: post #21
simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

[flagged]

It's simonw. It's interesting to see their pelican benchmark, another comment by a different author elsewhere here shows some very good SVG generation too.

Re: GPT-6 Astra on OpenRouter

#34

Post by claiir »

starik36 wrote: post #23

What is the actual utility of using this model on Azure? It's twice as expensive, according to the link. Do Azure offer something that simply hitting the OpenAI endpoint doesn't provide?

They’re ZDR and the OAI ones aren’t

Re: GPT-6 Astra on OpenRouter

#35

Post by satvikpendem »

XCSme wrote: post #22

That's some crazy SVG generation: https://aibenchy.com/compare/openai-gpt-6-astra-high/google-... It took a while to test it, initially OpenRouter was giving Not Found errors for this model ID.

That's quite shocking, at a sufficiently advanced level we can make all non-realistic graphics purely out of SVGs, as they'd have good scaling for things like logos and app icons. I know it was technically and theoretically possible before AI but most people weren't spending hours tweaking SVG HTML. I remember making an SVG dark mode toggle icon and it took days to get it right, I assume it's one shottable now.

Re: GPT-6 Astra on OpenRouter

#36

Post by Xunjin »

simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

Do you have other ideas of "combinations" for this kind of benchmark?

I'm wondering if this is being trained on by the models today.

Re: GPT-6 Astra on OpenRouter

#37

Post by BrokenCogs »

simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

Interesting that all of the bikes are turquoise colored, except for the medium effort

Re: GPT-6 Astra on OpenRouter

#38

Post by XCSme »

embedding-shape wrote: post #26
XCSme wrote: post #22

That's some crazy SVG generation: https://aibenchy.com/compare/openai-gpt-6-astra-high/google-... It took a while to test it, initially OpenRouter was giving Not Found errors for this model ID.

At the bottom it says "Score 98.58", what measure is used for this score? It's kind of horrible, the perspective is all off (legs of the table makes that very obvious), the mouse/hamster has two mouths, a stub for a right paw, looks like left hand holds a melon on a stick or something, and there are pluses in the background for some reason. Not sure it'd call it "close to perfect" which the score seems to want to ind…

I've replaced "Score" there with model ranking, to reduce confusion, thanks for the feedback!

Re: GPT-6 Astra on OpenRouter

#39

Post by [deleted] »

simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

[deleted]

Re: GPT-6 Astra on OpenRouter

#40

Post by lspears »

simonw wrote: post #19

I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…

Luna's price seems off
Post reply on HN