Live data from Hacker News

CaptionBot by Microsoft

captionbot.ai

121–130 of 170 posts

Re: CaptionBot by Microsoft

#122
post #98

I found it curious that this Bot is really bad at recognizing apes: chimpanzees and gorillas specifically. I fed it a lot of the images from a Google image search for these animals and more often than not it either doesn't recognize anything or considers them bears. I don't mean to offend, but I'm left wondering if the creators of image recognition services disincentivize their neural nets from recognizing something…

[deleted]

Re: CaptionBot by Microsoft

#124

CaptionBot team here. Thanks for the images and captions! Please keep sharing them and give us feedback.

It would be great if you added a text box under the stars so I can (optionally) tell you why I didn't give you five stars.

For example, I uploaded a picture of my daughter as an infant, and it said, "This is a baby on a bed and he's :D" which I gave four stars to because it said he instead of she. But honestly you really have no way of knowing that. :)

Re: CaptionBot by Microsoft

#125
It feels like there are two sides of this: either recognition is amazing, either is really really far.

It seems that after it generates the caption, this needs to be fed to some semantic pipe, so that a plane sitting on a book would not make sense, and try further.

After all, it really depends on the training data. If the picture of a train ticket was never seen by the NN, how could it answer correctly? How ever, it should try to reduce the answer to some more meaningfull info, for example instead of two giraffes near a tree, ideally would have said, it's a text and would attempt OCR.

Re: CaptionBot by Microsoft

#128

CaptionBot team here. Thanks for the images and captions! Please keep sharing them and give us feedback.

Do you know why it puts a lot of things on surfboards?

It seems from the comments that that is one of the most represented misclassifications.

Re: CaptionBot by Microsoft

#129
post #98

I found it curious that this Bot is really bad at recognizing apes: chimpanzees and gorillas specifically. I fed it a lot of the images from a Google image search for these animals and more often than not it either doesn't recognize anything or considers them bears. I don't mean to offend, but I'm left wondering if the creators of image recognition services disincentivize their neural nets from recognizing something…

Short answer: Yes, especially after Tay.
Post reply on HN