I wonder whether it would stay consistent if you gave it a solid background line
Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
21–30 of 98 posts
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#22Earlier quoted context omitted.
The interesting part (IMO) isn't that the AI classifies it as both a rabbit and a duck, but that the classification is dependent on the rotation of the picture. I can somewhat understand how that happens, but I find it's in an interesting observation (rather than a criticism on the system, though the title is somewhat unclear and had me expect something else).
But rotation does contain information. 6 and 9 can be considered as a case where rotation SHOULD change the classifier's output. AI does makes dumb predictions from time to time, but I my opinion, this isn't that strong a case. When it rotate upside down, it does look like a rabbit even to me. The more interesting 'failure' here to me, is that while the rotation is smooth, the prediction is not, instead it is flicker…
But only with context right? It is completely ambiguous if the character is 6 or 9 without some other clue, like which way up the paper is, or from the 4 next to it (if you assume that an arbitrary rotation may have occurred).
It is just a sign to me that doing some rotations as data augmentation is not good enough. Rotation invariance needs to be built into the architecture of the network (like translation invariance sort of gets in via max pooling).
I think it should be giving a 50/50 classification of duck and rabbit at all rotations if it was working as expected.
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#23Earlier quoted context omitted.
The interesting part (IMO) isn't that the AI classifies it as both a rabbit and a duck, but that the classification is dependent on the rotation of the picture. I can somewhat understand how that happens, but I find it's in an interesting observation (rather than a criticism on the system, though the title is somewhat unclear and had me expect something else).
But rotation does contain information. 6 and 9 can be considered as a case where rotation SHOULD change the classifier's output. AI does makes dumb predictions from time to time, but I my opinion, this isn't that strong a case. When it rotate upside down, it does look like a rabbit even to me. The more interesting 'failure' here to me, is that while the rotation is smooth, the prediction is not, instead it is flicker…
> AI does makes dumb predictions from time to time, but I my opinion, this isn't that strong a case.
I don't think it's meant as an example of a 'dumb prediction'. I think it's an interesting example that inspires (me at least) to think about how this recognition and classification works, and what could cause this effect.
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#24Earlier quoted context omitted.
But rotation does contain information. 6 and 9 can be considered as a case where rotation SHOULD change the classifier's output. AI does makes dumb predictions from time to time, but I my opinion, this isn't that strong a case. When it rotate upside down, it does look like a rabbit even to me. The more interesting 'failure' here to me, is that while the rotation is smooth, the prediction is not, instead it is flicker…
But only with context right? It is completely ambiguous if the character is 6 or 9 without some other clue, like which way up the paper is, or from the 4 next to it (if you assume that an arbitrary rotation may have occurred). It is just a sign to me that doing some rotations as data augmentation is not good enough. Rotation invariance needs to be built into the architecture of the network (like translation invarianc…
How often do you read upside down?
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#25Earlier quoted context omitted.
But only with context right? It is completely ambiguous if the character is 6 or 9 without some other clue, like which way up the paper is, or from the 4 next to it (if you assume that an arbitrary rotation may have occurred). It is just a sign to me that doing some rotations as data augmentation is not good enough. Rotation invariance needs to be built into the architecture of the network (like translation invarianc…
How often do you read upside down?
All the time, especially when I read to my kids.
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#26It would be cool to visualize this as a kind of pie chart, based on where the ears/beak is pointing. Blue for directions where it sees duck, red for rabbit, and empty for neither.
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#27When the output switches to rabbit the picture actually resembles a rabbit. I am unsure if this experiment was supposed to be a “haha look how stupid AI is” type thing or not, but it seems like the cloud vision api is performing as intended.
Since human would do the same error, I think it's kind of a praise of how close to human is the AI.
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#28While the title is clickbaity (as in adversarial examples for fooling neural networks e.g. by adding a baseball ball to a whale to make it shark), I think it shows a nice phenomenon.
I.e. a given illusion works similarily for humans and AI alike.
Vide "dirty mind" pictures like posting https://images.baklol.com/13_jpegbd9cb76b39e925881bdb2956fd3... to Clarifai https://clarifai.com/models/nsfw-image-recognition-model-e95... gives 88% for NSFW.
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#29Earlier quoted context omitted.
But rotation does contain information. 6 and 9 can be considered as a case where rotation SHOULD change the classifier's output. AI does makes dumb predictions from time to time, but I my opinion, this isn't that strong a case. When it rotate upside down, it does look like a rabbit even to me. The more interesting 'failure' here to me, is that while the rotation is smooth, the prediction is not, instead it is flicker…
Thank you for this comment. To me, duck v. rabbit on rotation just proves the system works as intended.
Exactly, I also see a duck and a rabbit depending on rotation.
Re: Is It a Duck or a Rabbit? For Google Cloud Vision, Depends on Image Rotation
#30That image is a visual illusion. I find it hard myself to detect that it's a rabbit when it's ears are horizontal like a mouth. Not sure what is the purpose of it, is it to show that even computers vision algorithms can get confused by visual illusions?
I find your response more interesting that the experiment. You don’t just rotate the image in your mind or focus on specific features to bring out the duckiness or rabbit-ness? I can make it more duck or more rabbit as will.
[deleted]