What GPU was used to train this model?
Text to Image Synthesis Using Thought Vectors
11–20 of 23 posts
Re: Text to Image Synthesis Using Thought Vectors
#12What GPU was used to train this model?
I trained it on an AWS instance with grid k520 gpu.
Re: Text to Image Synthesis Using Thought Vectors
#13I think the idea is interesting but I'm not convinced it really "synthesizes ideas" so much as treats the neural network like a database of images that it mixes.
Now, I could be wrong, but because of the way the results are presented it doesn't tell me that it's any good at picking up the meaning of the phrase. The results show a single phrase and a set of images it generates. White flower with yellow center, and a bunch of images of white flowers.
But if it can synthesize the idea properly, one should be able to generate a flower of a variety of descriptions. Yellow flower with blue center. Red flower with yellow center. Blue flower with black edges and black center. etc..
From the way they describe the functionality it should be able to do these things so in a way I don't doubt it, but I want to see how it performs on phrases that induce combinations of ideas that are well outside of the training set yet refer to individual ideas within the training set.
Re: Text to Image Synthesis Using Thought Vectors
#14I can see this being useful for police sketch artists.
Make sure your face isn't included in the learning set!
Re: Text to Image Synthesis Using Thought Vectors
#15This is lovely. As a lazy programmer, I would appreciate this as a web service. Instead of googling for an image to steal as placeholder art, I could request a uniquely generated image.
I think few have grasped how much of future output will be machine generated from existing work, and yet rather than violate copyright, almost be a necessity to ensure a copyright somewhere is not broken.
That's an interesting angle that I hadn't considered. I was discussing with a coworker who is into machine learning about overfitting: where the output could perfectly match the input in a flawed implementation.
Re: Text to Image Synthesis Using Thought Vectors
#16This is lovely. As a lazy programmer, I would appreciate this as a web service. Instead of googling for an image to steal as placeholder art, I could request a uniquely generated image.
I think few have grasped how much of future output will be machine generated from existing work, and yet rather than violate copyright, almost be a necessity to ensure a copyright somewhere is not broken.
[deleted]
Re: Text to Image Synthesis Using Thought Vectors
#17I think the idea is interesting but I'm not convinced it really "synthesizes ideas" so much as treats the neural network like a database of images that it mixes. Now, I could be wrong, but because of the way the results are presented it doesn't tell me that it's any good at picking up the meaning of the phrase. The results show a single phrase and a set of images it generates. White flower with yellow center, and a b…
How do you "synthesize ideas" if not by combining parts of your own personal database of images/concepts? Even in your example of "X flower with Y center [and Z features]" you start with a mental picture of a flower you've seen (or a generalisation from many flowers you've seen) and then modify it with your mental picture of colours X and Y and features Z.
Re: Text to Image Synthesis Using Thought Vectors
#18I can see this being useful for police sketch artists.
There is still a long way to go, to be able to do that. The model currently generates 64 X 64 pictures and is trained on a very specific flowers image dataset. Nevertheless, it would be a great idea to experiment with such a dataset (of sketches and descriptions) if available.
But the thing about machine learning is that once it works at all, "a long way to go" generally means "add more training data" rather than "we require significant conceptual breakthroughs".
Re: Text to Image Synthesis Using Thought Vectors
#19It would be cool to implement text to pizza image synthesis.
Hey, if you're gonna go in that direction why not just implement text-to-pizza synthesis where you say "I want a mushroom and jalapeno pizza with sundried tomatoes" and then it makes one for you.
Re: Text to Image Synthesis Using Thought Vectors
#20Earlier quoted context omitted.
I think few have grasped how much of future output will be machine generated from existing work, and yet rather than violate copyright, almost be a necessity to ensure a copyright somewhere is not broken.
That's an interesting angle that I hadn't considered. I was discussing with a coworker who is into machine learning about overfitting: where the output could perfectly match the input in a flawed implementation.
I'm literally working on this now as a side project. If the avenue I'm exploring is successful the concept of hiring artists will be completely changed.