Live data from Hacker News

CaptionBot by Microsoft

captionbot.ai

161–170 of 170 posts

Re: CaptionBot by Microsoft

#161
I wish services like this would be released without any kind of moral filter on the subjects it classifies.

I uploaded a picture of Michaelangelos David to the service to see what captionbot would say about it, and I got back a message "I think this may be inappropriate content so I won't show it."

Re: CaptionBot by Microsoft

#162
Yeah, the tech is not yet ready for prime time.

1) Close-up of a roman coin

- I think it's a banana peel

2) Inverse black-on-white outline drawing of a wolf howling at the moon (logo of comic series Elfquest)

- I am not really confident, but I think it's a close up of two giraffes near a tree.

3) Red-on-black drawing of eight arrows with a circle in the middle (chaos symbol).

- I am not really confident, but I think it's a red and white sign.

4) Red-on-black drawing of a hammer-and-sickle (communism symbol).

- I am not really confident, but I think it's a picture of some sort.

5) Ltd Cmdr Data laughing, one hand on his chest, the other extending outside the picture.

- I am not really confident, but I think it's a man holding a wii controller and he seems :D

6) Germaine Greer biting the head off a barbie, while shaking another off its ponytail

- I am not really confident, but I think it's a woman eating a doughnut and they seem :D D:

7) Image of a tiny lilac octopus on a black background

- I am not really confident, but I think it's a close up of a doughnut.

8) Red-on-black drawing of an "A" in a circle (anarchy symbol)

- I am not really confident, but I think it's a lamppost

9) Black-and-white picture of actress Liv Ulmann

- I am not really confident, but I think it's a man with a stuffed animal.

10) Portrait of countess Elisabeth Bathory

- I am not really confident, but I think it's a woman wearing a hat and she seems :|

For the record, number (10) is spot on (though with low confidence, so may be just random).

Re: CaptionBot by Microsoft

#165

CaptionBot team here. Thanks for the images and captions! Please keep sharing them and give us feedback.

Thank you very much for putting your work out there for people to have fun with (and criticise!).

CaptionBot seems to have a bit of trouble with simple two-colour outline drawings. In one case I saw it even get the colour wrong ("red and white" for a black and red image).

Is that something you would have expected?

Also- I notice it doesn't do very well with character recognition either. Is that surprising?

Re: CaptionBot by Microsoft

#167

CaptionBot team here. Thanks for the images and captions! Please keep sharing them and give us feedback.

Have you considered an 'abstract' type of version? As in, rather than simply describing the image as the caption, take the information that would be used, fill it in a MAD-LIBS[1] style setup, and see how that turns out? Maybe it's just me but a surrealist CaptionBot could be pretty fun.

[1] https://en.wikipedia.org/wiki/Mad_Libs

Re: CaptionBot by Microsoft

#168
post #48

Definitely not a picture of 2 giraffes near a tree: https://www.dropbox.com/s/ki9p59txh8mk143/Photo%20Apr%2013%2... It's just a Caltrain ticket ¯\_(ツ)_/¯

That's weird - $workchum fed it a screenshot of Perl 6 and it thought it was two giraffes.

Re: CaptionBot by Microsoft

#170
post #89

Hmm I can't help but think it should have done a little better with this image http://i.imgur.com/yBNJWKf.png

I've noticed that the bot does best with real photos. It goes wrong with cartoons or objects with a white/black background with no surrounding detail.
Post reply on HN