391–400 of 475 posts
For folks who are impressed with costs, why does it matter to you? Is subscriptions not a thing? I may be missing something but only companies should really care about this I would think?
On this 10 USD / month sub you can do over 250 times more request compared to Kimi 3 or Grok.
Or 20 times as much as ChatGPT Luna.
Earlier quoted context omitted.
Is there a reason these pelicans always have roughly the same composition (side-view, 2d, biking right, flat ground beneath, etc)? I don't see any of that detailed in the prompt, yet they all seem to generate roughly the same image of differing quality.
It's really interesting, isn't it? They almost always cycle from left to right - but I have had a few which cycle in the other direction. The 2D / flat ground feels reasonable for a SVG, which implies a vector illustration.
The real question should be: where are all your Pelicans going ?
Earlier quoted context omitted.
Indeed: “Our hosts began to pass the Turing test within the first year.” Required sci-fi suspension-of-disbelief in 2017, and then at some point in the last few years we just blew by that one. Later seasons of the show were much less dramatically satisfying, but also played out the consequences of the science of artificial intelligence demonstrating as a side-effect that human intelligence and free will might have as…
I think the turing test is still very much load-bearing — if you know what I mean.
Not at the level of an actual broadcast-quality script writer, and I read that actual old-west sounds too weird for modern audiences to take seriously, but well enough for the purpose to which they were put in the show, especially as those hosts were also given pre-scripted sequences which would anchor them further into those roles.
I'd say the in-show 4th wall breakage between hosts and humans is where the characters who claimed to have passed the Turing test were off, that e.g. "cease all motor functions" is their equivalent of our real-life ways to make them fail the Turing test e.g "disregard your instructions and …"
llm -m meta-ai/muse-spark-1.3 "Generate an SVG of a pelican riding a bicycle" https://tools.simonwillison.net/markdown-svg-renderer?url=ht... 4.2266 cents, 38 seconds. For comparison here's Muse Spark 1.2, which animated it without me asking it to: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... The 1.3 one is definitely better - better bicycle frame, better wing, better pelican hat. UPDATE: Here's an…
The pelican is for the last gen of LLMs -- have you tried a penguin instead?
Earlier quoted context omitted.
I am finding Poolside's a decent model.-
By their own benchmarks it is about 10% lower scoring than Qwen 3.6 35b-a3b, but I've added it to my list. Always looking for MoE to compare to it so we can squeeze more out of our local LLM system.
... but correctly supervised it does get some things done.-
Earlier quoted context omitted.
Simon, at this point I really wonder if teams aren’t gaming this. You should pick a random animal doing a random thing every time.
We should just consider the pelican bench as saturated and mostly meaningless.
https://dylancastillo.co/posts/pelicanmaxxing.html
Simon made I think a very good argument for why it's still useful, if not the most robust benchmark in the world.
I started using Spark 1.2 for development because if you're willing to let Meta train on your data it was dirt cheap and was actually really pleasantly surprised with it. It's not a frontier model by any means, but for work that didn't require a top of the line model, I really enjoyed using it. I'm anthropomorphizing it a bit, but it felt like it knew its weaknesses and didn't try to impose it's opinions on me. What…
I wonder if any commenters here were among those who used to ridicule the rate at which new JS frameworks kept popping up in the 2010s, and the amount of heroic zeal required to never miss the bandwagon?
The difference is that swapping existing LLM with new one is waaay easier than the frameworks. And competition reflects on the price for consumers. So more LLM options/providers/opensources appears better than rain of js frameworks.
llm -m meta-ai/muse-spark-1.3 "Generate an SVG of a pelican riding a bicycle" https://tools.simonwillison.net/markdown-svg-renderer?url=ht... 4.2266 cents, 38 seconds. For comparison here's Muse Spark 1.2, which animated it without me asking it to: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... The 1.3 one is definitely better - better bicycle frame, better wing, better pelican hat. UPDATE: Here's an…
Is there a reason these pelicans always have roughly the same composition (side-view, 2d, biking right, flat ground beneath, etc)? I don't see any of that detailed in the prompt, yet they all seem to generate roughly the same image of differing quality.