What’s interesting about datasets like this is that you can likely use it to distil an even more compressed SD generator from it.
Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
31–40 of 72 posts
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#32Great work! If anyone’s planning to use AI generated artwork in their projects, I’ve added an image search API to Lexica, similar to Unsplash. All the images are licensed CC0 and millions more are being added every few weeks. Docs here: https://lexica.art/docs
Great work on Lexica.art, it's been indispensable for finding good prompts and combinations. How much does it cost to host it? Feels like hosting 500GB of images and serving them can't be cheap.
Last month Lexica served a little over 1 billion images and the Cloudflare bill (I'm using R2 + workers) was a little over $5k. I've since gotten it down to a more reasonable amount after spending some time to re-encode the images to reduce our bandwidth usage significantly. If Lexica were running on AWS/S3 I imagine our first month's bill would be closer to $100k rather than $5k. This is only image serving, so not including costs to run the beefy CPU servers to run CLIP search, frontend, DB, backend, etc.
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#33I'm curious, I've seen a few sites like this which grab from the Stability Discord. Is there a way to quickly scrape this amount of data from a Discord server?
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#34What’s interesting about datasets like this is that you can likely use it to distil an even more compressed SD generator from it.
yup! btw, if you want compressed generators you'll enjoy this discussion https://discuss.huggingface.co/t/decoding-latents-to-rgb-wit...
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#35Great work! If anyone’s planning to use AI generated artwork in their projects, I’ve added an image search API to Lexica, similar to Unsplash. All the images are licensed CC0 and millions more are being added every few weeks. Docs here: https://lexica.art/docs
Been using Lexica quite a bit for prompt analysis, thanks for the work.
General browsing is heavily dominated by portraits though. I was wondering if it would be worth having a face detected flag on images so you could filter portraits.
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#36This is wild to me. Now we have meta-ai that is surrounding other forms of ai, analyzing the user submitted input as well as the image output, using ai to infer intent, identify nouns etc... and yet all of this is stipulated on the initial datasets that these initial text->img robots were trained on which may or may not be a true representation of our actual culture. So we are lava/magma layering all of these approxi…
We're living some crazy times! A truly AI summer. If you enjoy thinking about how the future of this field might look like, I highly recommend watching the interview between Yannic Kilcher and Sebastian Risi ( https://www.youtube.com/watch?v=_7xpGve9QEE ). I was mind-blown after hearing it. It was a long time since I didn't hear such an interesting conversation. It's crazy how Risi's ideas correlate so well with the…
> AI Summer
Thanks!
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#37This is fantastic, thanks for publishing it. I'm glad many players in the Stable Diffusion ecosystem is striving for openness (not only of the model itself but there are also open source frontends and related tooling)
Stable Diffusion was released just a month ago and look at the amount of applications and improvements that have been developed, it feels like a year! Open-source is the way to get the most out of this tech. We plan to keep building all the features that are to come at krea.ai in this way.
It is truly crazy the pace of updates. It's the first single topic I feel like I can't keep up with no matter how much time I spend with it.
It's like how they say Da Vinci's was the last generation that could know 'everything' but now we're getting into real-time too much new information!
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#38Show HN: I made 7k images with DALL-E 2 to create a reference/inspiration table
https://generrated.com https://news.ycombinator.com/item?id=32824448
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#39This is fantastic. A few days ago I was checking PromptBase [0] and thought it was a really good idea. Yours just took it to the next level being free with massive amount of data. Great work. [0] https://promptbase.com/
Thanks! I’d love to integrate our crawler with GitHub Actions and make it a self-updating dataset… There’s so much stuff to do!
Amazing work great stuff !!!!!
Re: Show HN: Open Prompts – dataset of 10M Stable Diffusion generations
#40Hey, was the specific Stable Diffusion version used to generate each image recorded anywhere in the dataset? In krea.ai, it doesn't say which version of the model was used to generate each image It appears that later versions are better in generating faces or something. Like, Stable Diffusion 1.5 vs 1.4 (I'm not sure but there's a great variability nonetheless and I wanted to know if the version of the model accounte…
Good question. All the generations in the dataset were generated with version 1.3.