The referenced 1948 paper was recently cited by Max Hodak at the presentation of Neuralink recently. Pretty amazing piece of work!
Visual Information Theory (2015)
21–30 of 50 posts
Re: Visual Information Theory (2015)
#22Nice post: author has good communication / teaching style, and firm grasp of the material. The visuals help make some of the concepts more intuitive. Bookmarked.
On an unrelated tangent, the way the page formats when printing is one of the best I've seen. No weird navigation cruft, and it seems there's even a style defined that sets book-style margins, such that the left and right margins alternate in length.
Re: Visual Information Theory (2015)
#23Earlier quoted context omitted.
Disagree, I don't find this a "toxic" comment. The parent makes a point. Such potential in my opinion from these researchers/engineers and instead gets scooped up by the big tech companies, hoarding the talent such that nobody can compete with them. Happy for Chris's decision to be at the big G doing his research, but it seems every researcher/engineer is obsessed with being at the big tech companies being on their r…
Working research for a big tech means you are much less subject to the “publish or perish” req of a university. It often isn’t a must have resume point, but it actually gives you a different kind of freedom.
Given that he was awarded a Thiel fellowship, this gives him more freedom to research what he wants and make an impact than big tech and can literally go anywhere.
But obviously chose Google.
Re: Visual Information Theory (2015)
#24Nice post: author has good communication / teaching style, and firm grasp of the material. The visuals help make some of the concepts more intuitive. Bookmarked.
incredible guy, he really is the 10x everything type: https://colah.github.io/cv.pdf
Wow, his internship host was Jeff Dean?
I knew @colah was amazing (his neural net articles come to mind), but this is a whole other level of awesome.
Re: Visual Information Theory (2015)
#25Nice post: author has good communication / teaching style, and firm grasp of the material. The visuals help make some of the concepts more intuitive. Bookmarked.
It's no accident. Olah is living a life and leading a movement dedicated to doing what you noticed.
Re: Visual Information Theory (2015)
#26Earlier quoted context omitted.
Chris Olah is first author on these papers in distill.pub: - https://distill.pub/2018/building-blocks/ - https://distill.pub/2017/feature-visualization/ - https://distill.pub/2016/augmented-rnns/ He explains his personal mission, doing research distillation to reduce research debt, in this essay: https://distill.pub/2017/research-debt/
I wish more people were interested in research distillation. Recently I've been searching for intuitive explanations of different areas of math, and while there are some great blogs that do so, the lack of such materials is indeed obvious. I don't think academia is going to contribute to this mission as it's mostly governed by a make-it-look-ridiculously-difficult-so-people-won't-find-it-approachable-and-thus-give-yo…
Your hostile attitude to the people putting the work in is disrespectful and inappropriate. It's like the people who make entitled demands of open source software authors.
Academics don't get rewarded for confusing each other, they have to create research that their peers appreciate, understand, and value.
Re: Visual Information Theory (2015)
#27Earlier quoted context omitted.
What a toxic comment. Many people would consider DeepDream and Inceptionism to be the spark that ignited a lot of creative work in deep learning, which Christopher Olah wrote on while at Google AI.
Disagree, I don't find this a "toxic" comment. The parent makes a point. Such potential in my opinion from these researchers/engineers and instead gets scooped up by the big tech companies, hoarding the talent such that nobody can compete with them. Happy for Chris's decision to be at the big G doing his research, but it seems every researcher/engineer is obsessed with being at the big tech companies being on their r…
Olah isn't even at Google anymore.
Re: Visual Information Theory (2015)
#28Earlier quoted context omitted.
Based on a ~20 minute or less reading/reflection of this post, or something more?
At least in terms of public output. He hasn't published anything in particular in the last few years, whereas the years when his income came from the fellowship (judging by blog output, his twitter, and his academic CV). Can't say what he's doing inside google of course, but it's a shame it's not ideas and knowledge that can be enjoyed by us, the lowly outsiders.
Please stop reposting the same false information.
Re: Visual Information Theory (2015)
#29Love this article. It makes statistics enjoyable and accessible. Most of Olah's old stuff is also really good, especially the one on manifolds and neural networks [1]
[1] https://colah.github.io/posts/2014-03-NN-Manifolds-Topology/
Re: Visual Information Theory (2015)
#30The visual presentation in this article is very similar with how small children are taught the theorems of multiplication and distributivity and simple series sums like triangle numbers.