Live data from Hacker News

The early History of the Singular Value Decomposition (1993) [pdf]

math.ucdavis.edu

51–60 of 85 posts

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#51
post #48

Earlier quoted context omitted.

Really? I find the part about the SVD in Axler's book extremely unhelpful, big blobs of opaque formulas and jargon with next to no explanation or context that basically require either knowing the topic fully beforehand or a huge amount of effort to parse. e.g. Axler's definition of singular values is the extremely dry and technical: > Suppose T is in L(V, W). The singular values of T are the nonnegative square roots…

From the preface “You cannot read mathematics the way you read a novel. If you zip through a page in less than an hour, you are probably going too fast. When you encounter the phrase “as you should verify”, you should indeed do the verification, which will usually require some writing on your part. When steps are left out, you need to supply the missing pieces. You should ponder and internalize each definition. For e…

That's all well and good, but you also shouldn't excuse authors for not providing context, motivation, or explanation under the theory that the students should really be figuring out the whole subject from scratch for themselves.

If you are really lucky the result of not explaining things might be an occasional exceptional student who works out a correct personal concept. But more commonly the result is just an unfilled gap in understanding and either a moderately motivated student who develops fluency with symbol twiddling but doesn't get the point of what they're doing or a less-motivated student who decides the topic sucks and gives up.

I've read a lot of linear algebra books, and I personally find Axler's to have average quality exposition and a not tremendously insightful point of view. I know other people who swear by the book though, so YMMV. It's more appropriate for a well prepared pure math student who wants to go to grad school and has a goal of internalizing a lot of jargon so they can read/write pure math papers than for a scientist or computer programmer.

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#52
post #48

Earlier quoted context omitted.

Really? I find the part about the SVD in Axler's book extremely unhelpful, big blobs of opaque formulas and jargon with next to no explanation or context that basically require either knowing the topic fully beforehand or a huge amount of effort to parse. e.g. Axler's definition of singular values is the extremely dry and technical: > Suppose T is in L(V, W). The singular values of T are the nonnegative square roots…

From the preface “You cannot read mathematics the way you read a novel. If you zip through a page in less than an hour, you are probably going too fast. When you encounter the phrase “as you should verify”, you should indeed do the verification, which will usually require some writing on your part. When steps are left out, you need to supply the missing pieces. You should ponder and internalize each definition. For e…

So you admit that chapter 7 does not read almost as poetry?

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#53
post #47

Earlier quoted context omitted.

Eigenvalue are more flexible than singular values -- If you have procedure for computing eigenvalues of C, squared singular values of X are eigenvalues of C=XX'. Left and write singular vectors of X and eigenvectors of XX' and X'X. For rotation rotation matrix, singular values are all 1. Meanwhile eigenvalues tell you angles of rotation https://math.stackexchange.com/questions/4874616/obtaining-a...

That's like saying spoons are more flexible than forks because you have soup (rotation matrices). Spoons and forks both work for rice (pos def matrices), and you'll want a fork for noodles (rectangular matrices).

You can use eigenvalue solver to find singular values of any matrix but not vica versa. Implementing eigenvalues needs complex numbers

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#54
post #47

Earlier quoted context omitted.

That's like saying spoons are more flexible than forks because you have soup (rotation matrices). Spoons and forks both work for rice (pos def matrices), and you'll want a fork for noodles (rectangular matrices).

You can use eigenvalue solver to find singular values of any matrix but not vica versa. Implementing eigenvalues needs complex numbers

And you can use a spoon to chop spaghetti into pieces. Say I have a 10,000 by 100 matrix (1M elements), squaring that to get a 10,000 x 10,000 (100M elements) matrix to get the singular vectors is probably a bad idea. That squares the condition number too.

The SVD staying in Reals when you have Real data is a nice feature.

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#55
post #48

Earlier quoted context omitted.

From the preface “You cannot read mathematics the way you read a novel. If you zip through a page in less than an hour, you are probably going too fast. When you encounter the phrase “as you should verify”, you should indeed do the verification, which will usually require some writing on your part. When steps are left out, you need to supply the missing pieces. You should ponder and internalize each definition. For e…

That's all well and good, but you also shouldn't excuse authors for not providing context, motivation, or explanation under the theory that the students should really be figuring out the whole subject from scratch for themselves. If you are really lucky the result of not explaining things might be an occasional exceptional student who works out a correct personal concept. But more commonly the result is just an unfil…

I agree completely. Sure, students could fill all the gaps themselves. But why not just fill the gaps and make good exercises?

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#56

Earlier quoted context omitted.

If you're getting code without tests to review in a PR, that should be an instant reject without even looking at the code .

Go ahead and have claude add and run units tests for you as part of the PR review process.

Claude is absolutely terrible at writing unit tests, this advice continues to perplex me. Coding agents usually slam you with hundreds of lines that do little more than “test” what is obvious. Maybe it’s good for an API revision or such. But for linear algebra where errors might not manifest unless suitably chosen inputs are generated based on expert knowledge, that’ll be useless.

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#57
post #31

Can anyone suggest a starting point to be able to read mathematics papers like this and understand them?

I really recommend Professor Gilbert Strang's linear algebra course and also would check out any Michael Penn videos, both on YouTube, but for linear algebra, the Strang/MIT course is the best resource anywhere that I know. The Gilbert Strang video series on linear algebra includes the 18.06 course, as well as an 18.06B or something like that where he goes into detail about the SVD and ML algorithms like gradient descent.

Generally if you're struggling with a math paper on the first or second page, no point in fighting it; gotta come back after you have the prerequisites. Nobody is born knowing this stuff, and also, all branches of math contain endless piles of really easy-to-describe but hopelessly difficult problems so never feel bad if you don't know how to solve a problem or even understand what you are reading. Just take your time, learn what you need, come back, a bit more hopefully makes sense, learn still more, and over time more things will become familiar.

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#59
post #6

Earlier quoted context omitted.

You seem to be conflating "RGB" with one particular RGB color space: sRGB. That's a common enough conflation to make, but not appropriate when you're trying to be pedantic.

Doesn't matter: there's no RGB model that captures the colour space. That exactly the reason CIE exists.

Not true, you can make the R G and B points far enough out to capture the entire human gamut

Re: The early History of the Singular Value Decomposition (1993) [pdf]

#60
post #48

Earlier quoted context omitted.

From the preface “You cannot read mathematics the way you read a novel. If you zip through a page in less than an hour, you are probably going too fast. When you encounter the phrase “as you should verify”, you should indeed do the verification, which will usually require some writing on your part. When steps are left out, you need to supply the missing pieces. You should ponder and internalize each definition. For e…

So you admit that chapter 7 does not read almost as poetry?

That is the poetry. When all parts clicks together.
Post reply on HN