Live data from Hacker News

What Is the Fourier Transform?

quantamagazine.org

81–90 of 214 posts

Re: What Is the Fourier Transform?

#83
post #78

I have a pet theory that the reason why the FT, and other transforms (generating functions, Mellin/Laplace/Legendre/Haar), are so useful is because many real world functions are sparse and lend themselves to compressed sensing. The FT, as are many other transforms, are 1-1, so, in theory, there's no information lost or gained. In many real world conditions, looking at a function in frequency space greatly reduces the…

As mentioned by other commenters, a reason for the FT's dominance in particular is because sine, cosine, and complex exponentials are the eigenfunctions of the derivative operator. Since so many real-world systems are governed by differential equations, the Fourier Transform becomes a natural lens to analyze these systems. Sound waves are one (of many) examples.

And there's another good reason why so many real-world signals are sparse (as you say) in the FT domain in particular: because so many real-world systems involve periodic motion (rotating motors, fly's wings as you noted, etc). When the system is periodic, the FT will compress the signals very effectively because every signal has to be harmonic of the fundamental frequency.

Re: What Is the Fourier Transform?

#85
post #78

I have a pet theory that the reason why the FT, and other transforms (generating functions, Mellin/Laplace/Legendre/Haar), are so useful is because many real world functions are sparse and lend themselves to compressed sensing. The FT, as are many other transforms, are 1-1, so, in theory, there's no information lost or gained. In many real world conditions, looking at a function in frequency space greatly reduces the…

As you noted, it’s about what’s important to us. The physical function may or may not be sparse, but our brain model is guaranteed to be sparse. A note played on a violin is anything but a sine function, yet our brains associate it with a single idealized tone. Our world model is super compressed.

Re: What Is the Fourier Transform?

#86
post #39

Isn’t the Fourier series fundamentals generally a required course in undergraduate college EE field?

Yes, but how many software engineers remember any of that? Most aren't using it.

Indeed, because a Golomb ruler optimized DFT is performant... and thus actually useful. lol =3

Re: What Is the Fourier Transform?

#87
For lossy compression, turns out a sinusoidal (typically DCT) composition maximizes energy compaction and compress ability. A proof that this is true for AR-processes was a key realization for me. That you get a nice and intuitive domain to work with (modify frequencies) is a nice bonus on top :)

Re: What Is the Fourier Transform?

#88
post #78

I have a pet theory that the reason why the FT, and other transforms (generating functions, Mellin/Laplace/Legendre/Haar), are so useful is because many real world functions are sparse and lend themselves to compressed sensing. The FT, as are many other transforms, are 1-1, so, in theory, there's no information lost or gained. In many real world conditions, looking at a function in frequency space greatly reduces the…

As mentioned by other commenters, a reason for the FT's dominance in particular is because sine, cosine, and complex exponentials are the eigenfunctions of the derivative operator. Since so many real-world systems are governed by differential equations, the Fourier Transform becomes a natural lens to analyze these systems. Sound waves are one (of many) examples. And there's another good reason why so many real-world…

The question is why "so many real-world systems are governed by differential equations" and "so many real-world systems involve periodic motion".

Well, stable systems are can either be stationary or oscillatory. If the world didn't contain so many stable systems, or equivalently if the laws of physics didn't allow so, then likely life would not have existed. All life is complex chemical structures, and they require stability to function. Ergo, by this anthropic argument there must be many oscillatory systems.

Re: What Is the Fourier Transform?

#89
Applying FT to images is a great way to see the world very differently, as if through an alien's eyes (or Geordi's visor from ST TNG!). A kind of stimulated out-of-the-box thinking. Dense features like fur or hair manifest as high-frequency components and eventually you start to develop an intuition for their patterns in the magnitude / power spectrums.

Re: What Is the Fourier Transform?

#90

Earlier quoted context omitted.

As mentioned by other commenters, a reason for the FT's dominance in particular is because sine, cosine, and complex exponentials are the eigenfunctions of the derivative operator. Since so many real-world systems are governed by differential equations, the Fourier Transform becomes a natural lens to analyze these systems. Sound waves are one (of many) examples. And there's another good reason why so many real-world…

The question is why "so many real-world systems are governed by differential equations" and "so many real-world systems involve periodic motion". Well, stable systems are can either be stationary or oscillatory. If the world didn't contain so many stable systems, or equivalently if the laws of physics didn't allow so, then likely life would not have existed. All life is complex chemical structures, and they require s…

> The question is why "so many real-world systems are governed by differential equations" and "so many real-world systems involve periodic motion". > > Well, stable systems are can either be stationary or oscillatory. If the world didn't contain so many stable systems, or equivalently if the laws of physics didn't allow so, then likely life would not have existed. All life is complex chemical structures, and they require stability to function. Ergo, by this anthropic argument there must be many oscillatory systems.

I would say that the it's very difficult to imagine a world that would not be governed by differential equations. So it's not just that life wouldn't exist it's that there wouldn't be anything like the laws of physics.

As a side note chaotic systems are often better analysed in the FT domain, so even in a world of chaotic systems (and there are many in our world, and I'd argue that if there wasn't life would not exist either) the FT remains a powerful tool

Post reply on HN