The quadratic sandwich
fedemagnani.github.io
The quadratic sandwich
1–10 of 17 posts
Re: The quadratic sandwich
#2The animation is very good, making the article easy to understand
Re: The quadratic sandwich
#3The animation is very good, making the article easy to understand
We studied it in our peparation for college entrance exams in India. Though the detail the article goes in is exhaustive. But I thought that this maybe common or almost common knowledge.
We used to call it sandwich theorem
Re: The quadratic sandwich
#4[flagged]
Re: The quadratic sandwich
#5The animation is very good, making the article easy to understand
We studied it in our peparation for college entrance exams in India. Though the detail the article goes in is exhaustive. But I thought that this maybe common or almost common knowledge. We used to call it sandwich theorem
The sandwich theorem would normally refer to this one: https://en.wikipedia.org/wiki/Squeeze_theorem
Re: The quadratic sandwich
#6Great visualizations. Really enjoyed having a well-written example where mathematical proofs directly help with understanding a practical application.
I wonder what would happen with this analysis if a momentum term was added to the gradient descent. It seems that it would fix the specific failure modes in the examples, but I wonder if there's a corresponding mathematical way of categorizing what kinds of functions can(not) be quickly optimized with GD + momentum.
Re: The quadratic sandwich
#7Simplex methods can handle those tough situations, though.
Re: The quadratic sandwich
#8Earlier quoted context omitted.
We studied it in our peparation for college entrance exams in India. Though the detail the article goes in is exhaustive. But I thought that this maybe common or almost common knowledge. We used to call it sandwich theorem
The sandwich theorem would normally refer to this one: https://en.wikipedia.org/wiki/Squeeze_theorem
I immediately thought of the ham sandwich theorem
Re: The quadratic sandwich
#9There is one very clear example that I ran across due to the reasons outlined in the article. If you have a wavelet and you're trying to slide it around to make it fit, that will fail spectacularly. There are lots of problems that boil down to basically the above.
The neural net answer is being able to spawn a wavelet at any position, as opposed to tweaking the position of an existing one.
Re: The quadratic sandwich
#10Kudos for beatiful formulae rendering.