CaptionBot by Microsoft
121–130 of 170 posts
Re: CaptionBot by Microsoft
#122I found it curious that this Bot is really bad at recognizing apes: chimpanzees and gorillas specifically. I fed it a lot of the images from a Google image search for these animals and more often than not it either doesn't recognize anything or considers them bears. I don't mean to offend, but I'm left wondering if the creators of image recognition services disincentivize their neural nets from recognizing something…
Re: CaptionBot by Microsoft
#123Re: CaptionBot by Microsoft
#124CaptionBot team here. Thanks for the images and captions! Please keep sharing them and give us feedback.
For example, I uploaded a picture of my daughter as an infant, and it said, "This is a baby on a bed and he's :D" which I gave four stars to because it said he instead of she. But honestly you really have no way of knowing that. :)
Re: CaptionBot by Microsoft
#125It seems that after it generates the caption, this needs to be fed to some semantic pipe, so that a plane sitting on a book would not make sense, and try further.
After all, it really depends on the training data. If the picture of a train ticket was never seen by the NN, how could it answer correctly? How ever, it should try to reduce the answer to some more meaningfull info, for example instead of two giraffes near a tree, ideally would have said, it's a text and would attempt OCR.
Re: CaptionBot by Microsoft
#126Re: CaptionBot by Microsoft
#127Re: CaptionBot by Microsoft
#128CaptionBot team here. Thanks for the images and captions! Please keep sharing them and give us feedback.
It seems from the comments that that is one of the most represented misclassifications.
Re: CaptionBot by Microsoft
#129I found it curious that this Bot is really bad at recognizing apes: chimpanzees and gorillas specifically. I fed it a lot of the images from a Google image search for these animals and more often than not it either doesn't recognize anything or considers them bears. I don't mean to offend, but I'm left wondering if the creators of image recognition services disincentivize their neural nets from recognizing something…