Alright results are in! I've re-run all my editing based adherence related prompts through Nano Banana Pro. NB Pro managed to successfully pass SHRDLU, the M&M Van Halen test (as verified independently by Simon), and the Scorpio street test - all of which the original NB failed. Model results 1. Nano Banana Pro: 10 / 12 2. Seedream4: 9 / 12 3. Nano Banana: 7 / 12 4. Qwen Image Edit: 6 / 12 https://genai-showdown.spec…
I had to look up what a "skifter" is. An AI answer showed that it's Norwegian for a switch. I'm curious, does the word have a further meaning in the context of cheating at cards?
It's an admittedly obscure reference to a cheating technique used in the Star Wars card game sabacc, which allows a player to surreptitiously switch out a card. I’m pretty sure I picked it up from one of Timothy Zahn's Thrawn books when I was a kid.
But I didn't know it had a meaning in Norwegian, so I guess TIL!
Alright results are in! I've re-run all my editing based adherence related prompts through Nano Banana Pro. NB Pro managed to successfully pass SHRDLU, the M&M Van Halen test (as verified independently by Simon), and the Scorpio street test - all of which the original NB failed. Model results 1. Nano Banana Pro: 10 / 12 2. Seedream4: 9 / 12 3. Nano Banana: 7 / 12 4. Qwen Image Edit: 6 / 12 https://genai-showdown.spec…
Seedream generally looks like low quality outputs and it doesn’t seem like you’re assigning points for quality. This is only marginally helpful.
That's because, for the most part, I'm not:
"A comparison of various SOTA generative image models on specific prompts and challenges with a strong emphasis placed on adherence."
Adherence is the more interesting problem, in my opinion, because quality issues can be ameliorated through the use of upscalers, refiner models, LoRAs, and similar tools. Furthermore, there are already a thousand existing benchmarks obsessed with visual fidelity.
Alright results are in! I've re-run all my editing based adherence related prompts through Nano Banana Pro. NB Pro managed to successfully pass SHRDLU, the M&M Van Halen test (as verified independently by Simon), and the Scorpio street test - all of which the original NB failed. Model results 1. Nano Banana Pro: 10 / 12 2. Seedream4: 9 / 12 3. Nano Banana: 7 / 12 4. Qwen Image Edit: 6 / 12 https://genai-showdown.spec…
I think Nano banana pro’s answer to the giraffe edit is far superior to the Seedream response, but you passed Seedream and failed NB pro. Maybe that one is just not a good test?
yeah i agree, the prompt is to "shorten the giraffe's neck length", not to bent it. i feel like the Gemini 3 produces better result on that one
Google has been stomping around like Godzilla this week, and this is the first time I decided to link my card to their AI studio. I had seen people saying that they gave up and went to another platform because it was "impossible to pay". I thought this was strange, but after trying to get a working API key for the past half hour, I see what they mean. Everything is set up, I see a message that says "You're using Paid…
>I decided to link my card to their AI studio.
A lot of us did this in the last 2 days. Gemini3 first and now this.
> Generate better visuals with more accurate, legible text directly in the image in multiple languages Assuming that this new model works as advertised, it's interesting to me that it took this long to get an image generation model that can reliably generate text. Why is text generation in images so hard?
Largely but not entirely a data problem; specifically poor captioning. High quality captioning makes such a big difference.
thanks, I love your website. Are you planning to do NB Pro for the text-to-image benchmark too?
Outside the time frame of being able to edit my original reply, but I've finally re-run the Text-to-Image portion of the site through NB Pro. Results gpt-image-1: 10 / 12 Nano Banana Pro: 9 / 12 Nano Banana: 8 / 12 It's worth mentioning that even though it only scored slightly better than the original NB, many of the images are significantly better looking. https://genai-showdown.specr.net?models=nb,nbp
Awesome test suite. For the maze though, not sure it’s fair to knock it for extra dashed lines as the prompt didn’t specify that only the correct path should have one…
> It's still a computer, and we still shouldn't trust everything we see. The fundamentals haven't changed. I think that by now it should be crystal clear to everyone that it matters a lot the sheer scale a new technology permits for $nefarious_intent. Knives (under a certain size) are not regulated. Guns are regulated in most countries. Atomic bombs are definitely regulated. They can all kill people if used badly, th…
I think we're overreacting. Digital fakes will proliferate, and we'll freak out bc it's new. But after a certain amount of time, we'll just get used to it and realize that the world goes on, and whatever major adverse effects actually aren't that difficult to deal with. Which is not the case with nuclear proliferation or things like that. The story of human history is newer generations freaking about progress and nov…
instead of making everyone watermark the AI, we should have cameras that take and sign pictures securely. requires hardware!
Everyone who worked on this is a traitor to the human race. Why do we need to make it impossible to make a living as an artist? Who thinks an endless tsunami of garbage “content” churned out by machines dropping the bottom out of all artistic disciplines is a good idea?
(Shrug) If you expect to coast through an uneventful, unchallenging career, neither art nor technology are going to be great options for you. Learn to mine coal or something, I guess. Or... put your hands on the most amazing art tools since the Renaissance and go make something awesome.
No one using these tools will produce anything even a tenth as impressive as what was born out of the Renaissance, since their efforts were born of mastery, understanding, patience, a keen eye, and a love of nature and life. One who outsources their creativity and thinking to a machine will produce meaningless 'art' as empty as the shrinking contours of their mind as it withers away from non-use. Our world is not want for more quantity as we already drown in excess, and the quality and meaning inherit in masterful works of art born out of ones own hands will one day once again find their way to the center of our consciousness, as the world learns again that the value of art lies not solely in its appearances, but in its revelation of the human soul by means of Beauty, by which a human endeavors by great effort and skill to impart some aspect of their fleeting glimpse of the divine and sacred nature of being, by which our being here now as people of this earth and time consists of, which binds us all, now and through our history and our future.
This thing's ability to produce entire infographics from a short prompt is really impressive, especially since it can run extra Google searches first. I tried this prompt: Infographic explaining how the Datasette open source project works Here's the result: https://simonwillison.net/2025/Nov/20/nano-banana-pro/#creat...
Is the infographic accurate in terms of the way datasette wprks?