Live data from Hacker News

Neural Networks Demystified

lumiverse.io

61–66 of 66 posts

Re: Neural Networks Demystified

#62
post #48

I am very interested in this subject but I was unable to finish watching these videos. The background music is incredibly distracting. I have a name for that kind of music, I call it Silicon Valley Music because it is the kind of music used in a lot of startup product videos. The narrator voice style is also pretty much the same that is used in those. I wanted to like these videos but I did not feel that they had any…

I'm confused by your comment. You seem to be saying two different things: 1) The music and choice of narrator is getting in the way of the (presumably valuable) content. 2) The content itself, regardless of the choice of narrator or whether or not there's music behind it, is not useful. If it's the latter then why complain about the former?

People feel discomfort while listening to these videos because they feel like they are being persuaded by a weak young man to believe things he himself does not believe. This is caused by:

1. High pitch voice. Either it is modulated or not, the voice informs us that a person we are listening to is low social status, therefore subconsciously we assign lesser significance to anything he says.

2. Infomercial-like intonation. Guy may be professional narrator, and his intonation is like you would find in advertisements where someone tries to sell you something really worthless. So people again subconsciously tend to "categorize" this kind of information as unwanted and are used to filtering it out. The effect is strengthened by the choice of music.

3. The narrator clearly has no understanding (or gives that impression) about the subject he is told to talk about. This is subconsciously felt by people through his intonation and the way to put emphasis on random words, and that also translates to two things: again reminds us of infomercials (meaningless talking to occupy time) and malicious persuasion - he wants me to believe in something he does not believe (actually does not understand).

This all adds up to our brain signaling something is wrong, therefore complaints. There is more to education than content.

Re: Neural Networks Demystified

#64
Plan A: The material is difficult, so present it very slowly and carefully.

Plan B: To avoid boredom, present the material as quickly and densely as possible, with lots of constantly changing detail, with simultaneous visual, audio and even some light background music.

These videos are a bit like "Hitchhiker's Guide to the Galaxy" meets "Khan Academy".

Some people will like them, and some won't. I like them.

Re: Neural Networks Demystified

#65
post #53

To demystify NNs further we need to stop graphically representing spurious interactions. If you can perturb or remove a link win between any two neurons i & j, then that interaction is spurious and shouldn't be represented by in the graphical network representation. Doing this iteratively you can start to better appreciate that neural networks are computational circuits that use thereshold functions instead of logic…

To me 'demystifying' really means making simpler to understand. Yours sounds like technical pedantry, that while true (idk?) is meaningless to anyone who actual needs a neural net demystified.

Um, no. Show an electrical engineer the circuit diagram of an 8-bit added and they'll know the function right away. The function of the NN is similarly determined by the topological circuitry--in fact the function can often be preserved when you represent these networks as Boolean network, but all that's concealed when we don't remove spurious connections and it starts to feel like weird voodoo mathemagic. This is not an opinion, I've published on this and have seen scientist get confused because of it.

Re: Neural Networks Demystified

#66
post #33
post #23

In case the author of the videos is here, do you have plans to add some videos about Convolutional NNs and Recurrent NNs? I know a lot of developers like myself that know about traditional NNs, but are not familiar with those two.

Not the author, but I wrote an article introducing conv nets you might find helpful: http://colah.github.io/posts/2014-07-Conv-Nets-Modular/ I also have an article on RNNs, although it's focused on explaining a special version, called an LSTM: http://colah.github.io/posts/2015-08-Understanding-LSTMs/ If you have experience with functional programming, you might find this a nice way to think about Conv Nets/RNNs/etc:…

Thanks. Very nice articles.
Post reply on HN