Neural Networks That Describe Images
cs.stanford.edu
Neural Networks That Describe Images
1–10 of 63 posts
Re: Neural Networks That Describe Images
#2At the Bay Area Vision Meeting in 2013 [1], Fei-Fei Li and Olga
Russakovsky gave a related talk on, "Analysis of Large-Scale Visual
Recognition" [2,3]
[1] http://bavm2013.splashthat.com/
[2] video: http://www.youtube.com/watch?v=DK6KfUsVN8w
[3] slides: http://bavm2013.splashthat.com/img/events/46439/assets/a10b....
Re: Neural Networks That Describe Images
#3It would be great to have this for image search!
Re: Neural Networks That Describe Images
#4this is unsettling and amazing. not too far when we'll have robots that will be aware of what's going on around it.
Re: Neural Networks That Describe Images
#5Fascinating. Also interesting to see the failure modes. Any human would quickly realize that the "boy doing backflip on wakeboard" is actually playing on a trampoline. Or the "two young girls playing with legos toy". Great stuff!
Re: Neural Networks That Describe Images
#6[deleted]
Re: Neural Networks That Describe Images
#7this is unsettling and amazing. not too far when we'll have robots that will be aware of what's going on around it.
[deleted]
Re: Neural Networks That Describe Images
#8It would be great to have this for image search!
Yup! That's exactly why there has been so much work on this from the likes of Google. Video and images represent a "dark media" in terms of indexing and search. It is very difficult without robust tagging (which is time intensive or relies on the articles and descriptions that surround the images) to search through images. This technology would make it much easier perform robust querying of this data.
Re: Neural Networks That Describe Images
#9Idk if this is a daft question, but in the Visual-Semantic Alignment section, are those objects in the colored boxes actually being directly recognized by the software? Or are they inputted in some other way?
Re: Neural Networks That Describe Images
#10Idk if this is a daft question, but in the Visual-Semantic Alignment section, are those objects in the colored boxes actually being directly recognized by the software? Or are they inputted in some other way?
From the paper: Our core insight is that we can leverage these large image-sentence datasets by treating the sentences as weak labels, in which contiguous segments of words correspond to some particular, but unknown location in the image. Our approach is to infer these alignments and use them to learn a generative model of descriptions.