Live data from Hacker News

Eigenvectors and Eigenvalues (2015)

setosa.io

71–80 of 87 posts

Re: Eigenvectors and Eigenvalues (2015)

#71

Earlier quoted context omitted.

I'm doing some fluid simulation (CFD), and the actual code for finite differences is simple. But the analysis (of stability etc) is more mathy, and I don't feel confident reading other needed papers, because they are couched in math. I mean, I can and have coded it, but can't be sure how it how it will behave in all situations. So I can understand these papers, I'm going back to study math properly. I'm not fully con…

I work in Engineering and feel somewhat similar about CFD. There's always some element of doubt lurking in the back of my mind "is it really correct in all circumstances". The most useful info I learnt at university were a couple of equations: Bernoulli's (for general observation about expected pressure drop), Ergun's (for flow through packed beds) and the general laws of thermodynamics. Those are mostly enough to be…

Have you seen the Method of Manufactured Solutions (MMS)?

You guess ("manufacture") a solution to the PDE. Then you plug it into the PDE. It won't be correct, so you just add source terms to make it correct. You now have an analytical solution for this PDE with those source terms. You can now run your simulation (with those source terms) and compare it with the "correct" solution.

Unfortunately, you'll introduce discretization error, because your delta x and delta t aren't infinitessimal. But using the order of accuracy of your discretization method, you know how the error should change with delta x and delta t. So you graph error against delta x, on log-log, and see if the curve matches the order of accuracy. Apparently, it shows up even minor bugs in your code really well.

This approach scares me a little, because how do I know my math is correct? I need better appreciation of how the order of accuracy interacts over time as well as space; the behaviour of error summaries; and how log-log plotting works.

Re: Eigenvectors and Eigenvalues (2015)

#72
post #59
post #11

Earlier quoted context omitted.

This is frightening but believable. I've worked with a few "quants" who stared at me doe eyed explaining eigen* and basic calculus concepts to them in the context of why their calculations don't add up. You mention you've used fourier transforms before - if you don't understand an eigenbasis then you don't have a fundamental understanding the math you're deploying.

> You mention you've used fourier transforms before - if you don't understand an eigenbasis then you don't have a fundamental understanding the math you're deploying. That's a bit uncharitable. A fourier decomposition can absolutely be understood as an explicit bag of calculus tricks, with no loss of precision or generality. And an awful lot can be done with just those tools -- you don't need to explain JPEG compress…

Dude your post is orthogonal

Re: Eigenvectors and Eigenvalues (2015)

#73

Earlier quoted context omitted.

>I follow a number of education channels on YouTube Any recommendations? I would love to look into channels that you think are like 3Blue1Brown but in other subjects (natural sciences, history, art etc.).

Edit: I realize I overlooked the "like 3Blue1Brown" prereq, instead sharing a list of the educational/interesting channels I find worthwhile. The most like 3Blue1Brown will be the PBS ones (especially SpaceTime), MinutePhysics, and Mathologer, for using diagrams to convey abstract concepts. PBS Space Time and Eons are both awesome: * PBS Space Time, covers cosmology and quantum physics: https://www.youtube.com/channe…

Awesome but no Vsauce?

https://www.youtube.com/channel/UC6nSFpj9HTCZ5t-N3Rm3-HA

Re: Eigenvectors and Eigenvalues (2015)

#74

Earlier quoted context omitted.

3Blue1Brown (Grant Sanderson) is really, really good. I follow a number of education channels on YouTube, and Grant blows them all out of the water for the kind of insights, new perspectives, and inspiration he provides. His animations are fantastically put together to clearly and unobtrusively illustrate the point he's making. I also really like his voice, soothing, clear and with enough intonation to avoid boredom,…

I’ve taken 3 college level courses on linear algebra and only really got an intuition for eigenvectors/eigenvalues when watching his video series. Super great!

I had problems with Principal Component Analysis; nice to see he's got one on that as well!

http://setosa.io/ev/principal-component-analysis/

(edit: ugh, contains an ad for MacKeeper)

Re: Eigenvectors and Eigenvalues (2015)

#75

Earlier quoted context omitted.

I’ve taken 3 college level courses on linear algebra and only really got an intuition for eigenvectors/eigenvalues when watching his video series. Super great!

I had problems with Principal Component Analysis; nice to see he's got one on that as well! http://setosa.io/ev/principal-component-analysis/ (edit: ugh, contains an ad for MacKeeper)

What, you don't want to remove your mac from trash?

Incidentally, that particular grammatical quirk is one I've seen a number of times. Is it a thing for people coming from Russian? Or just general difficulty with remembering the order of the two subjects in two-subject phrases?

Re: Eigenvectors and Eigenvalues (2015)

#76

3Blue1Brown has a good series on YouTube for building intuition in linear algebra: https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2x... In one of the last videos in the (relatively short) series, he discusses eigen-*: ~'eigen-stuffs are straight-forward but only make sense if you have a solid visual understanding of the pre-requisites (linear transformations, determinants, linear systems of equations, chan…

I just finished watching both his calculus series and linear algebra. I have to say 3blue1brown has made a mathematical masterpiece of a youtube series

Neither of those subjects really clicked with me until I could visualize it in a 2D / 3D representation

Re: Eigenvectors and Eigenvalues (2015)

#77

Earlier quoted context omitted.

>I follow a number of education channels on YouTube Any recommendations? I would love to look into channels that you think are like 3Blue1Brown but in other subjects (natural sciences, history, art etc.).

Edit: I realize I overlooked the "like 3Blue1Brown" prereq, instead sharing a list of the educational/interesting channels I find worthwhile. The most like 3Blue1Brown will be the PBS ones (especially SpaceTime), MinutePhysics, and Mathologer, for using diagrams to convey abstract concepts. PBS Space Time and Eons are both awesome: * PBS Space Time, covers cosmology and quantum physics: https://www.youtube.com/channe…

I just realized I had 80% of these subscribed already, then I looked at how many channels I subscribed too (700+)

I like tinkering with things so I have some mechanical / electrical engineering / makers on my list as well.

I listed my favorites of that list here

* Tom Scott - Lots of interesting unique topics related to engineering, programming, and history

https://www.youtube.com/channel/UCBa659QWEk1AI4Tg--mrJ2A

* Colin Furze - Lots of crazy welding projects

https://www.youtube.com/channel/UCBa659QWEk1AI4Tg--mrJ2A

* Mark rober - ex-nasa engineer, similar to SmarterEveryDay

https://www.youtube.com/channel/UCY1kMZp36IQSyNx_9h4mpCg

* Hacksmith - just interesting project build videos normally related to marvel comics

https://www.youtube.com/user/MstrJames

* Live overflow - web / binary hacking with great case studies

https://www.youtube.com/channel/UClcE-kVhqyiHCcjYwcpfj9w

* Wendover productions - Great documenatires on things like Airplane and shippping logistics

https://www.youtube.com/wendoverproductions

* Strange parts - ex-programmer who sources components and parts overseas

https://www.youtube.com/channel/UCO8DQrSp5yEP937qNqTooOw

Re: Eigenvectors and Eigenvalues (2015)

#78

3Blue1Brown has a good series on YouTube for building intuition in linear algebra: https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2x... In one of the last videos in the (relatively short) series, he discusses eigen-*: ~'eigen-stuffs are straight-forward but only make sense if you have a solid visual understanding of the pre-requisites (linear transformations, determinants, linear systems of equations, chan…

It’s possible to understand eigen-* without having an understanding of determinants. That’s how they’re introduced in “Linear Algebra Done Right” - http://linear.axler.net/

Re: Eigenvectors and Eigenvalues (2015)

#79

3Blue1Brown has a good series on YouTube for building intuition in linear algebra: https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2x... In one of the last videos in the (relatively short) series, he discusses eigen-*: ~'eigen-stuffs are straight-forward but only make sense if you have a solid visual understanding of the pre-requisites (linear transformations, determinants, linear systems of equations, chan…

It’s possible to understand eigen-* without having an understanding of determinants. That’s how they’re introduced in “Linear Algebra Done Right” - http://linear.axler.net/

And they exist in situations where determinants are difficult or impossible to define! Infinite dimensional vector spaces can still have transformations with eigenvectors but you generally can't define a determinant coherently for them (certainly they might have infinitely many eigenvalues and if the determinant is the product, then you have convergence problems). A classic example is that the standard Gaussian distribution is an eigenvector of the Fourier transform.

Re: Eigenvectors and Eigenvalues (2015)

#80

Earlier quoted context omitted.

Edit: I realize I overlooked the "like 3Blue1Brown" prereq, instead sharing a list of the educational/interesting channels I find worthwhile. The most like 3Blue1Brown will be the PBS ones (especially SpaceTime), MinutePhysics, and Mathologer, for using diagrams to convey abstract concepts. PBS Space Time and Eons are both awesome: * PBS Space Time, covers cosmology and quantum physics: https://www.youtube.com/channe…

Awesome but no Vsauce? https://www.youtube.com/channel/UC6nSFpj9HTCZ5t-N3Rm3-HA

Y'know, I hesitated. I admit I'm somewhat ambivalent about VSauce, because Michael's somewhat wandering style makes it closer to entertainment than the usually more focused topics the other channels on my list work with. That said, Vsauce is definitely interesting and great for fostering curiosity and an inquisitive mindset.

Also his new channel DONG ("Do Online Now Guys"... wut?):

https://www.youtube.com/channel/UClq42foiSgl7sSpLupnugGA

Also I should've mentioned Veritasium:

https://www.youtube.com/channel/UCHnyfMqiRRG1u-2MsSQLbXA

Post reply on HN