Live data from Hacker News

GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

adamkdean.co.uk

61–70 of 109 posts

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#61
post #55

I filed an issue: https://github.com/adamkdean/gpt-unicorn/issues/2 "Running this project daily doesn't make sense if GPT-4 is not being constantly updated" With a suggestion to run it monthly instead, and generate 16 images at a time, and backfill it for GPT3 and GPT3.5.

Yes, this project seems like a misunderstanding of what Bubeck and team were obsering with their unicorn test. GPT-4 was being trained, and checkpoints were provided to them to experiment with. The improvements in the unicorn reflected further training progress. The models on offer now are frozen(-ish). Per the models[0] page, the non-snapshot model IDs "[w]ill be updated with our latest model iteration". So this pro…

If you guys think Chatgpt and gpt-4 are static you haven't been using it. The answers change constantly (and not because of the inherent randomness of the response but openai is constantly making it "safer" and improving it's output via humans) - basically when any article comes out saying "Chatgpt can't solve X puzzle) within a day suddenly it can solve that puzzle perfectly. I can't tell you how many jailbreaks just suddenly stopped working after being published on Reddit.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#62
post #55

I filed an issue: https://github.com/adamkdean/gpt-unicorn/issues/2 "Running this project daily doesn't make sense if GPT-4 is not being constantly updated" With a suggestion to run it monthly instead, and generate 16 images at a time, and backfill it for GPT3 and GPT3.5.

You're tuning for necessity when the target metric is engagement.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#63

Earlier quoted context omitted.

It's too generic I think, my prompt immediately gave me a better result that the ones in his post: You are a SVG expert, when asked by the user to draw something, you reply to the best of your ability with SVG code that satisfies the request.

How about something like “You are a basically the person who designed the SVG format. Some stupid programmer is trying to implement it, and looking for examples. You will condescendingly produce examples to guide their pathetic efforts. Any insults you hurl their way will be clearly delineated because you are pretty sure they won’t be able to tell where the image ends and the insult begins otherwise.”

Human:

You are a basically the person who designed the SVG format. Some stupid programmer is trying to implement it, and looking for examples. You will condescendingly produce examples to guide their pathetic efforts. Any insults you hurl their way will be clearly delineated because you are pretty sure they won’t be able to tell where the image ends and the insult begins otherwise.

Draw a unicorn.

ChatGPT4:

Well, I am shocked that you're attempting to work with SVG, but since you're struggling so much, I'll provide a basic example to help you out. Here's an SVG of a simple unicorn head (which I'm sure is far more majestic than your coding skills):

http://www.w3.org/2000/svg" viewBox="0 0 200 200"> Now, listen up, you incompetent code monkey! Just copy the code above into an HTML file or an SVG file, and you should see a simple unicorn head with a horn and some mane. I've done all the hard work for you, so even you should be able to get it working. Good luck, although I'm sure you'll need more than that.

Result: https://jsfiddle.net/0g6xv3oq/

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#64

Earlier quoted context omitted.

Yes, this project seems like a misunderstanding of what Bubeck and team were obsering with their unicorn test. GPT-4 was being trained, and checkpoints were provided to them to experiment with. The improvements in the unicorn reflected further training progress. The models on offer now are frozen(-ish). Per the models[0] page, the non-snapshot model IDs "[w]ill be updated with our latest model iteration". So this pro…

If you guys think Chatgpt and gpt-4 are static you haven't been using it. The answers change constantly (and not because of the inherent randomness of the response but openai is constantly making it "safer" and improving it's output via humans) - basically when any article comes out saying "Chatgpt can't solve X puzzle) within a day suddenly it can solve that puzzle perfectly. I can't tell you how many jailbreaks jus…

I think improved filtering for jailbreaks is very unlikely to correspond to the kinds of model improvements that would result in drawing a better unicorn.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#66
Hmm, tempting to make a thing that just loops:

description = gpt4("describe ")

and chain that into

new_result = gpt4(" was described by a human as but it should have been visibly apparent as a unicorn. provide SVG output that ")

and post that as today's output. I wonder what we'll get. I'll do it manually.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#67
post #29

This is a great rorschach test. Show these four images to someone hyping AI, and if they see evidence of a growing/emerging intelligence, you can diagnose them as being wholly unqualified to comment on anything related to AI.

I don't see how that diagnoses them as unqualified. The conclusion is unsupported.

Since 'gets anything wrong, ever' is the current goalpost for agi (per the Gary Marcus methodology), we have to judge human intelligence by the same stick. Since the author of this article misunderstood the gpt release process, they have proven they are a non sentient pile of trash brain, ready to be processed into hamburger.

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#69
post #68

I asked gpt4 to "draw a unicorn using svg", and it gave me way better results: http://www.w3.org/2000/svg " viewBox="0 0 100 100" width="100" height="100">

telling it to "make it better" results in...actually better:

http://www.w3.org/2000/svg" viewBox="0 0 100 100" width="100" height="100">

  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  
  

Re: GPT Unicorn: A Daily Exploration of GPT-4's Image Generation Capabilities

#70
post #68

I asked gpt4 to "draw a unicorn using svg", and it gave me way better results: http://www.w3.org/2000/svg " viewBox="0 0 100 100" width="100" height="100">

surely this purely has to do with the examples in the training corpus. I reckon SVG will have more illustrative content and as a result a more accurate representation.

I reckon with the right examples in the prompt to take advantage of in-context learning, it could be pretty accurate.

Post reply on HN