Live data from Hacker News

Keras reimplementation of "One pixel attack for fooling deep neural networks"

github.com

11–20 of 84 posts

Re: Keras reimplementation of "One pixel attack for fooling deep neural networks"

#12
post #11

Isn't the fact that it's one pixel of a 32*32 image relevant? I'd be more impressed to see a neural network be succesfully attacked by a single (or dozens) of pixels on a full-res image.

The fact that a human isn't fooled by the attack (we can still recognize the 32x32 images for what they are), points to an interesting gap in the abilities of conventional convolutional neural nets.

Re: Keras reimplementation of "One pixel attack for fooling deep neural networks"

#13
I wonder how well capsule networks could deal with this, considering they're more robust than traditional CNNs towards other sorts of adversarial attacks. My guess is that one-pixel changes are going to do very little to alter pose information (though they will still alter the confidence of the feature existing), and so caps nets should be more robust here as well. Does anyone know if my intuition is correct?

Link to the capsule network paper, for those who haven't heard of it: https://arxiv.org/abs/1710.09829

Re: Keras reimplementation of "One pixel attack for fooling deep neural networks"

#14
post #11

Isn't the fact that it's one pixel of a 32*32 image relevant? I'd be more impressed to see a neural network be succesfully attacked by a single (or dozens) of pixels on a full-res image.

The fact that a human isn't fooled by the attack (we can still recognize the 32x32 images for what they are), points to an interesting gap in the abilities of conventional convolutional neural nets.

Not a new concept in general, just a new approach for it with a single pixel change.

Re: Keras reimplementation of "One pixel attack for fooling deep neural networks"

#15
post #11

Isn't the fact that it's one pixel of a 32*32 image relevant? I'd be more impressed to see a neural network be succesfully attacked by a single (or dozens) of pixels on a full-res image.

The fact that a human isn't fooled by the attack (we can still recognize the 32x32 images for what they are), points to an interesting gap in the abilities of conventional convolutional neural nets.

That's only because the attack is designed to target that particular network. Just wait until we understand real brains better and can generate tailored attacks...

Re: Keras reimplementation of "One pixel attack for fooling deep neural networks"

#17

Can we use one pixel attack to train network? We would generate adversarial examples to train network. Having ability to create Training Set that maximizes learning factor for NN sounds amazing but I think we would run to other adversarial examples.

There are a nearly infinite amount of forgery possibilities. The best solution seems to be making multiple networks with different approaches and training sets. Use a consensus or refer to a human if there is none. Finding holes should become harder with this approach.

Re: Keras reimplementation of "One pixel attack for fooling deep neural networks"

#19
post #15

Earlier quoted context omitted.

The fact that a human isn't fooled by the attack (we can still recognize the 32x32 images for what they are), points to an interesting gap in the abilities of conventional convolutional neural nets.

That's only because the attack is designed to target that particular network. Just wait until we understand real brains better and can generate tailored attacks...

Isn't that basically what an optical illusion is?

Re: Keras reimplementation of "One pixel attack for fooling deep neural networks"

#20
post #19
post #15

Earlier quoted context omitted.

That's only because the attack is designed to target that particular network. Just wait until we understand real brains better and can generate tailored attacks...

Isn't that basically what an optical illusion is?

Plus cognitive biases. Those are already well understood and used in a variety of ways.
Post reply on HN