I remember doing something like this without the neural networks that is, but my results were very very bad. If i find that project in old laptop i'll post it to github.
Neural Networks That Describe Images
41–50 of 63 posts
Re: Neural Networks That Describe Images
#42Before going through on object recognition in images, I'm curious about how they managed to arrange perfect sentence for the caption. Are we already at the point where NN can arrange perfect sentence when we throw bunch of words into it?
They're not perfect but similar to what NN-based machine translators output; it's not completely consistent.
E.g.
"girl in pink dress is jumping in air."
vs
"black and white dog jumps over bar."
Re: Neural Networks That Describe Images
#43Presentations like these make me realize how close we are to developing law enforcement (/police state) technology that will be very effective. I figure when the kinks are smoothed out, that we could run this on a video feed, and have crimes prevented right as they're about to happen. It's almost scary. Imagine 20 years from now, some guy pulls a gun on you, and a video feeds identifies his action, and immediately sh…
I imagine more preventative solutions to develop earlier which are more effective, e.g., "treat" citizens who are predicted highly likely to be cause a dangerous outcome in the future. Or in the simple context of computer vision and the camera, raise warnings as individuals on screen act increasingly more suspicious. I imagine future technology will at least have intelligent security cameras that signal alarms based…
And you have just described the plot of an anime named Psycho-Pass (https://en.wikipedia.org/wiki/Psycho-Pass)!
Re: Neural Networks That Describe Images
#44Presentations like these make me realize how close we are to developing law enforcement (/police state) technology that will be very effective. I figure when the kinks are smoothed out, that we could run this on a video feed, and have crimes prevented right as they're about to happen. It's almost scary. Imagine 20 years from now, some guy pulls a gun on you, and a video feeds identifies his action, and immediately sh…
I fear greatly for the false positives that will inevitably happen, and the mass oppression of society that could result from the natural instinct to avoid them. When every action even slightly against the norms of society at the time can be acted upon and countered, the chilling effect on freedom could be immense.
You had to live -- did live, from habit that became instinct -- in the assumption that every sound you made was overheard, and, except in darkness, every movement scrutinized. -George Orwell, 1984.
Re: Neural Networks That Describe Images
#45Something doesn't seem right. If we are this good in image recognition, how come we are still using captchas? Are we so good in image recognition that it can identify young girl, bunch of bananas, guitar etc just by training it from an image set of just few thousand image. Whats the catch ? On one hand google says their self-driving car can't understand all the situations on the road while this algorithm can identify…
Captcha's largely fight the lowest common denominator, my making those who don't care enough (or have the knowledge) to work around them when they can just go elsewhere, so that you can invest your human resources fighting the more sophisticated attackers that actually target you.
They are reasonably successful because spammers have enough other targets that not many see it as worth the extra effort (and clock cycles) to break them, not because most of them are particularly hard to beat any more.
Re: Neural Networks That Describe Images
#46Presentations like these make me realize how close we are to developing law enforcement (/police state) technology that will be very effective. I figure when the kinks are smoothed out, that we could run this on a video feed, and have crimes prevented right as they're about to happen. It's almost scary. Imagine 20 years from now, some guy pulls a gun on you, and a video feeds identifies his action, and immediately sh…
Minority Report style
Re: Neural Networks That Describe Images
#47I'm impressed but skeptic, too. Laypeople might not get an accurate impression on what is possible.
Considering the image with the guy in a black shirt playing guitar. What if it was a picture of a naked man standing next to a black shirt that is hanging on a clothes hook, and next to it is a guitar is mounted on a rack: My guess it that the computer will still spit out: Guy in black shirt playing guitar, just because this sentence is very plausible in the underlying language model.
Re: Neural Networks That Describe Images
#48Earlier quoted context omitted.
I think I'm a human, but I did not realize that boy was on a trampoline instead of a wakeboard until you pointed it out. I think the water in the background confused me. I was also probably biased by reading the network's label before reaching my own judgment.
> I think I'm a human You sure? :) I definitely think the text does bias your interpretation though, I did the exact same.
> > I think I'm a human
> You sure?
Sounds suspiciously like something a neural net would say ...
Re: Neural Networks That Describe Images
#49Something doesn't seem right. If we are this good in image recognition, how come we are still using captchas? Are we so good in image recognition that it can identify young girl, bunch of bananas, guitar etc just by training it from an image set of just few thousand image. Whats the catch ? On one hand google says their self-driving car can't understand all the situations on the road while this algorithm can identify…
Captcha's largely fight the lowest common denominator, my making those who don't care enough (or have the knowledge) to work around them when they can just go elsewhere, so that you can invest your human resources fighting the more sophisticated attackers that actually target you. They are reasonably successful because spammers have enough other targets that not many see it as worth the extra effort (and clock cycles…
Breaking captchas also have an incentive that has been attractive enough to create an three entire industries -- spam, malware and security products to deal with spam and malware.
Re: Neural Networks That Describe Images
#50I am pretty sure some of those examples are correct only by a chance. "little girl is eating piece of cake."? Only thing that marks her as a girl is hair clip, did the software really saw that?
"woman is holding bunch of bananas." hell, I (hopefully a human) would recognize her as a male at first glance.