A visual proof that neural nets can compute any function
neuralnetworksanddeeplearning.com
A visual proof that neural nets can compute any function
1–10 of 86 posts
Re: A visual proof that neural nets can compute any function
#2[deleted]
Re: A visual proof that neural nets can compute any function
#3[deleted]
Re: A visual proof that neural nets can compute any function
#4As mentioned in the article, the formal statement is actually "neural nets can approximate (arbitrarily well, using the supremum metric) any continuous function". For other norms, it can also approximate non-continuous functions.
Re: A visual proof that neural nets can compute any function
#5I liked this article a lot, but I found it extremely confusing how some of the diagrams were interactive and some weren't. Why not make them all interactive? Barring that, an obvious visual indicator when one is interactive would be handy. As it was, I clicked on a lot of static images.
Re: A visual proof that neural nets can compute any function
#6[deleted]
Re: A visual proof that neural nets can compute any function
#7As mentioned in the article, the formal statement is actually "neural nets can approximate (arbitrarily well, using the supremum metric) any continuous function". For other norms, it can also approximate non-continuous functions.
It would have been pretty interesting if this had NOT held.
It would have meant that even though "neural nets can NOT approximate (arbitrarily well, using the supremum metric) any continuous function", a neural network (the humans involved) was able to discover this limitation.
I find the idea of a neural net finding a limitation of a neural net, to be interesting.
Re: A visual proof that neural nets can compute any function
#8who's to doubt neural networks are completely awesome ?
Any more news about those chips that were optimized for neural networks ? Was it IBM or Samsung ?
Re: A visual proof that neural nets can compute any function
#9As mentioned in the article, the formal statement is actually "neural nets can approximate (arbitrarily well, using the supremum metric) any continuous function". For other norms, it can also approximate non-continuous functions.
Yep, my first thought upon seeing the title was: wait, what about non-computable functions?
Re: A visual proof that neural nets can compute any function
#10who's to doubt neural networks are completely awesome ? Any more news about those chips that were optimized for neural networks ? Was it IBM or Samsung ?
We have very few theoretical results about neural networks. So not completely awesome.