Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

adamkdean.co.uk

Post reply on HN
Print view View original

51–60 of 109 posts

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#51

Post by int_19h »

ratg13 wrote: post #25
sp0rk wrote: post #7

Did you generate a bunch all at once before starting to get some idea of what the natural variance looks like? I would think it's important to verify some level of progression over time, because with the current four it seems entirely possible that the examples could have all been generated at the same time with no changes to the model.

Aren’t they using the March 14 model like the general public? It’s frozen in time, there are no updates to it.. All of these will be drawn using the same model until they push a new update, or you switch to a different GPT But I already think they proved the point that the generation is random enough that it would be extremely difficult to track progress this way.

When I ask GPT-4 to draw a unicorn, I get this:

https://i.imgur.com/HQ1Vjp0.png

And when I ask it to draw Mona Lisa, I get this:

https://i.imgur.com/gsBU49w.png

So far as I can see, the only difference is that the GitHub repo uses the API; the ones that I have were rendered using the web chat UI. Which makes me wonder if they're using the bleeding edge model for the chat.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#52

Post by int_19h »

dmix wrote: post #14
abrichr wrote: post #4

Earlier quoted context omitted.

They appear to be here: https://github.com/adamkdean/gpt-unicorn/blob/master/src/lib... { role: 'system', content: `You are a helpful assistant that generates SVG drawings. You respond only with SVG. You do not respond with text.` }, { role: 'user', content: `Draw a unicorn in SVG format. Dimensions: 500x500. Respond ONLY with a single SVG string. Do not respond with conversation or codeblocks.` }

Sadly it outputs raw svg code so you have to save it locally as .svg to see it. Or just insert it into an HTML page via devtools if you're lazy like me.

You can ask it to output HTML with SVG embedded if you want. Just make sure you also ask it to not do that in form of if you want to inspect the actual SVG output, because it can and sometimes will do that unprompted.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#53

Post by int_19h »

JonathanFly wrote: post #49

Look at this majestic beast GPT-4 just drew! https://imgur.com/a/ogZ6qI0 Interestingly, I think you often get better results with ChatGPT web interface than the API (the OP used a system message), but for a funny reason. Because ChatGPT typically first responds by insisting it can't actually draw, it ends up accidentally chain-of-thought prompting itself into drawing better. "I can't draw, but I can describe a detail…

Here's a somewhat more convoluted example:

https://imgur.com/a/yhIGvho

The first image is what came out of the initial prompt. Then I tried to get it to improve things and to add animations; the second image is the end result (and yes, the sun is animated as described). Here's the complete chat log:

https://gist.github.com/int19h/18bb9d96b4d8418da2531513970d8...

It's obviously far from perfect, but the fact that it can do this much already - meaning that it understands broadly how the objects would relate to each other spatially for something like this - is already extremely impressive IMO, given that its training and inputs are entirely textual.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#54

Post by JonathanFly »

int_19h wrote: post #53
JonathanFly wrote: post #49

Look at this majestic beast GPT-4 just drew! https://imgur.com/a/ogZ6qI0 Interestingly, I think you often get better results with ChatGPT web interface than the API (the OP used a system message), but for a funny reason. Because ChatGPT typically first responds by insisting it can't actually draw, it ends up accidentally chain-of-thought prompting itself into drawing better. "I can't draw, but I can describe a detail…

Here's a somewhat more convoluted example: https://imgur.com/a/yhIGvho The first image is what came out of the initial prompt. Then I tried to get it to improve things and to add animations; the second image is the end result (and yes, the sun is animated as described). Here's the complete chat log: https://gist.github.com/int19h/18bb9d96b4d8418da2531513970d8... It's obviously far from perfect, but the fact that it c…

Totally agree. The samples in the OpenAI paper didn't seem that impressive and there were so few of them, I assumed it must not be very good. But even the one-shot version of the scenery you linked is great. Very efficient use of SVG features.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#55

Post by simonw »

I filed an issue: https://github.com/adamkdean/gpt-unicorn/issues/2

"Running this project daily doesn't make sense if GPT-4 is not being constantly updated"

With a suggestion to run it monthly instead, and generate 16 images at a time, and backfill it for GPT3 and GPT3.5.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#57

Post by [deleted] »

ansk wrote: post #40
syntaxing wrote: post #33

Earlier quoted context omitted.

I don’t get it, wouldn’t something like HuggingGPT be able to command stable diffusion to do this? Just because GPT can’t do this natively doesn’t mean it’s not possible with the right framework?

These images were all generated by an identical model. The fact that this individual has convinced themself that the model is improving indicates that they don't understand how these models are trained and deployed. Furthermore, any conclusions reached on such limited data reveal more about one's predisposed opinions than anything about the nature of the data. Show this person an ink blot and they very well may see a…

[deleted]

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#58

Post by flangola7 »

ansk wrote: post #29

This is a great rorschach test. Show these four images to someone hyping AI, and if they see evidence of a growing/emerging intelligence, you can diagnose them as being wholly unqualified to comment on anything related to AI.

I don't see how that diagnoses them as unqualified. The conclusion is unsupported.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#59

Post by kristjansson »

simonw wrote: post #55

I filed an issue: https://github.com/adamkdean/gpt-unicorn/issues/2 "Running this project daily doesn't make sense if GPT-4 is not being constantly updated" With a suggestion to run it monthly instead, and generate 16 images at a time, and backfill it for GPT3 and GPT3.5.

Yes, this project seems like a misunderstanding of what Bubeck and team were obsering with their unicorn test. GPT-4 was being trained, and checkpoints were provided to them to experiment with. The improvements in the unicorn reflected further training progress.

The models on offer now are frozen(-ish). Per the models[0] page, the non-snapshot model IDs "[w]ill be updated with our latest model iteration". So this project will eventually hit another version of the model, but (a) one image definitely will not be enough to reliably discern a difference and (b) seems like that 'latest model iteration' cadence will be much, lower than a day.

[0]: https://platform.openai.com/docs/models

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#60

Post by tyingq »

Thought it might do better if asked it to use the javascript canvas api. The comments it added seemed promising. But the end result wasn't much better.

Prompt was: Draw a unicorn using the javascript canvas api

https://jsfiddle.net/za7Ltk65/ I added the minimal css and html, but the JS is verbatim what it spit out.

Post reply on HN