Live data from Hacker News

Hacking the Brain with Adversarial Images

spectrum.ieee.org

1–10 of 32 posts

Re: Hacking the Brain with Adversarial Images

#3
This reminds me strongly of the BLIT series of short stories, in which a category of images is discovered that cause processing problems ‘glitches’ in the human brain with fatal results.

http://www.infinityplus.co.uk/stories/blit.htm

That’s the first one, others are available online too.

Re: Hacking the Brain with Adversarial Images

#4

With attacks like this it would never be safe to use image recognition in any applications where human life depends on accurate results.

Because my favorite hobby is modifying my liver so that the biopsy picture confuses the cancer detection algorithm. :)

Re: Hacking the Brain with Adversarial Images

#6
post #4

With attacks like this it would never be safe to use image recognition in any applications where human life depends on accurate results.

Because my favorite hobby is modifying my liver so that the biopsy picture confuses the cancer detection algorithm. :)

I’m thinking more along the lines of cars, surveillance, heavy construction equipment etc.

Re: Hacking the Brain with Adversarial Images

#7
post #5

So if I make a cat look like a dog, people think it's a dog. That's amazing and totally unexpected.

The point is that the human brain is just as vulnerable to the adversarial attacks that people are claiming will be the downfall of ML. It's like the people that scream about people shining lasers into the cameras of autonomous vehicles - yeah, sure, if you did the same thing to a human driver you'd get exactly the same crash, why are you suddenly worried about this?

And it's more than just "making it look like a dog". If you look at it for any length of time it's obvious that it's a picture of a cat with some noise on it. But if you only have 100ms to respond to it you are guaranteed (>95% misidentification) to say that it's a cat. Now what happens if you take this and make your car look like a tree? Someone could crash and that would be terrible! Cancel driving, tear up the roads, ban wheels, cars were a mistake! /s

Re: Hacking the Brain with Adversarial Images

#8
Article subheading:

>Researchers from Google Brain show that adversarial images can trick both humans and computers, and the implications are scary

So the IEEE is telling me how to feel about this article in addition to presenting the facts. One might even consider that "hacking the brain with adversarial text". :-)

>A worrying possibility is that supernormal stimuli designed to influence human behavior or emotions...

Sooooo, like clickbait headlines? :-)

Re: Hacking the Brain with Adversarial Images

#9
post #4

Earlier quoted context omitted.

Because my favorite hobby is modifying my liver so that the biopsy picture confuses the cancer detection algorithm. :)

I’m thinking more along the lines of cars, surveillance, heavy construction equipment etc.

https://xkcd.com/1958/
Post reply on HN