111–120 of 255 posts
That's some crazy SVG generation: https://aibenchy.com/compare/openai-gpt-6-astra-high/google-... It took a while to test it, initially OpenRouter was giving Not Found errors for this model ID.
>Playing ping pong from the side of the table
I think marketing might be getting a bit absurd at this point
I posted this in the other Astra thread but it's just fallen off the homepage, so... Pelicans from Astra, plus 5.6 Sol, Terra, Luna for comparison: https://static.simonwillison.net/static/2026/gpt-6-and-5.6-p... I think this is a genuinely interesting comparison grid. Astra may be more expensive, but if you have a budget of 10 cents for a Pelican Astra low gives you something SO much better than the other models. Ast…
$10/$50 is incredibly expensive compared to Chinese models which are cents. I think they’re really going to struggle selling these models long-term. My company is already massively cutting down on access because they’ve realised most people don’t actually produce any value using it. All the tokenmaxers have ruined it for the rest of us now that accounting have seen the costs.
It's ability to handle non-90 degree cutouts and shapes for web dev is one of the best I've seen. The vision model on this is VERY capable. Here's an image design source of truth: https://image.non.io/78f4cd8b-2560-4643-9a51-96a89171f994.we... And here's the page it build from it: https://image.non.io/e7d3a9e5-f9df-4fd8-b79f-1f90280f978f.we... Note the flowing svg lines, and how accurately it recreated them. Here's O…
I was really hoping for Astra to be less expensive then Opus...
It's ability to handle non-90 degree cutouts and shapes for web dev is one of the best I've seen. The vision model on this is VERY capable. Here's an image design source of truth: https://image.non.io/78f4cd8b-2560-4643-9a51-96a89171f994.we... And here's the page it build from it: https://image.non.io/e7d3a9e5-f9df-4fd8-b79f-1f90280f978f.we... Note the flowing svg lines, and how accurately it recreated them. Here's O…
Earlier quoted context omitted.
You would not expect the developers of the model to optimize for a well known benchmark?
Here's 'Generate an SVG of a ring-tailed lemur riding an electric scooter' at reasoning level max: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... Quote from the thinking trace: > I’m thinking about how a helmet would obscure lemur ears, but using an electric scooter helmet seems responsible. It's pretty solid - face is a little wonky but excellent tail and scooter.
Earlier quoted context omitted.
No, both of them look awful. I genuinely am unsure if this is a meme you're making that's going over my head...?
Well, this was the state of SVG generation until a few months ago: https://aibenchy.com/showcase/?page=2#showcase=67fc6d6c8e4c3... https://aibenchy.com/showcase/?page=3#showcase=c215b5c915da6...
is Azure for this actually ZDR?
The only reason most of my customers would use Azure Foundry instead of OpenAI directly is the ZDR assurance but it is so incredibly difficult to extract out of their model menu.
There is no trivial way to block non-ZDR models either so every customer has to “vet” and individually approve models.
If anyone from Microsoft is reading this: get your act together! You’re failing at the one thing people might want to pay you to do!