This could be super cool for logos. I've tried using Stable Diffusion to generate logos and it does pretty good at helping brainstorm, but the text is always gibberish so you can use its idea, but you have to add your own text which basically means creating a logo from scratch using its designs as inspiration.
DeepFloyd IF: open-source text-to-image model
151–160 of 237 posts
Re: DeepFloyd IF: open-source text-to-image model
#152GitHub: https://github.com/deep-floyd/IF
Colab Notebook for running the model based on the diffusers library: https://colab.research.google.com/github/huggingface/noteboo...
Hugging Face Space for testing the model: https://huggingface.co/spaces/DeepFloyd/IF
Note that the model is substantially more compute-intensive than Stable Diffusion, so it may be slower even though that space is running on an A100.
Re: DeepFloyd IF: open-source text-to-image model
#153GitHub: https://github.com/deep-floyd/IF Colab Notebook for running the model based on the diffusers library: https://colab.research.google.com/github/huggingface/noteboo... Hugging Face Space for testing the model: https://huggingface.co/spaces/DeepFloyd/IF Note that the model is substantially more compute-intensive than Stable Diffusion, so it may be slower even though that space is running on an A100.
HF also wrote a blog post on how you can mess around with the model in a python notebook using their excellent Diffusers library: https://huggingface.co/blog/if
Re: DeepFloyd IF: open-source text-to-image model
#154I think this model will result in a massive new wave of meme culture. AI's already seen success in memes up to this point, but the ability for readable text to be incorporated into images totally changes the game. Going to be an interesting next few months on the interwebz, that's for sure. Exciting times!
Re: DeepFloyd IF: open-source text-to-image model
#155Is this intended to replace Stable Diffusion? Somebody want to give the eli5?
This does outperform Stable Diffusion 2.1, but uses a different architecture and requires more memory and compute. Stable Diffusion runs its denoising process in a compressed "latent space" which is how it was able to be so compute-efficient compared to other diffusion models. It also uses the (relatively) small text encoder from OpenAI's CLIP model to encode user prompts. Both of these optimizations meant that it co…
[deleted]
Re: DeepFloyd IF: open-source text-to-image model
#156Seeing a lot of text-to-image out there recently. Does anyone know what the current state of the art is on image-to-text? Thinking something similar to Midjourney's /describe command that they added in v5
Re: DeepFloyd IF: open-source text-to-image model
#157Earlier quoted context omitted.
> Stability AI releases DeepFloyd IF, a powerful text-to-image model Hope not. This is a worse license.
This is the dumb part about open-source models. Criminals, governments, and propaganda spreaders need not worry about the license; but legitimate users do.
This is the same problem with laws. The only people that follow them are legitimate users.
Re: DeepFloyd IF: open-source text-to-image model
#158Earlier quoted context omitted.
> Stability AI releases DeepFloyd IF, a powerful text-to-image model Hope not. This is a worse license.
As far as I can tell from Emad's discord and twitter discussion, the idea appears to be to make this a "research" release, and therefore the worse license. At a later point the model will be renamed "StableIf", and released with a similar license to StableDiffusion.
Yeah Emad was clarifying this on the LAION discord the other day — plan is to have a better-licensed version out Eventually™, guess we'll see how long that takes.
Re: DeepFloyd IF: open-source text-to-image model
#159Seeing a lot of text-to-image out there recently. Does anyone know what the current state of the art is on image-to-text? Thinking something similar to Midjourney's /describe command that they added in v5
While it's not publicly available yet, I have strong suspicions that multimodal GPT-4 may actually be SOTA in image-to-text. The examples shown in the Sparks of AGI paper were extremely impressive imo, though of course those are cherry-picked so it's unclear how well the model will perform on non-cherry-picked images.
Re: DeepFloyd IF: open-source text-to-image model
#160GitHub: https://github.com/deep-floyd/IF Colab Notebook for running the model based on the diffusers library: https://colab.research.google.com/github/huggingface/noteboo... Hugging Face Space for testing the model: https://huggingface.co/spaces/DeepFloyd/IF Note that the model is substantially more compute-intensive than Stable Diffusion, so it may be slower even though that space is running on an A100.
HF also wrote a blog post on how you can mess around with the model in a python notebook using their excellent Diffusers library: https://huggingface.co/blog/if
I knew the model would have difficulty fitting into a 16GB VRAM GPU, but "you need to load and unload parts of the model pipeline to/from the GPU" is not a workaround I expected.
At that point it's probably better to write a guide on how to set up a VM with a A100 easily instead of trying to fit it into a Colab GPU.