Viewing profile — steppi

Tao does state his hopes in the article: "My hope is that the winning submissions will capture the most productive techniques for solving these problems, and/or provide general pro…

It seems like the lift in the open-source models is being used as a proxy metric, and the core goal is a human understandable yoga [1] for approaching these kinds of equational pro…

I spent some time in industry working on ML-based credit risk modeling. In my experience, successful shops that have a genuine interest in applying their models to practical decisi…

Yes, people try this. Check out dynamic tonality. It doesn't necessarily need a system. Experienced guitar players often find themselves unconsciously making little microtonal adju…

I was planning to make a similar comment. Conjecturing that some theory in the string theory landscape [0] gives a theory of quantum gravity consistent with experiments that are po…

I don't think they usually make the distinction in a formal sense, but I think most are aware. The space of explorable mathematics is vastly larger than what the community of mathe…

I'd say that I care deeply about the meaning behind theorems, but just find results which swing widely based on foundational quirks to be less interesting from an aesthetic standpo…

It seems like a typo where "integers" is used when the intention was to write "natural numbers". That is the solution to exercise 194 part a) which asked if the set of natural numb…

Vladimir Arnold famously taught a proof of the insolubility of the Quintic to Moscow Highschool students in the 1960s using a concrete, low-prerequisite approach. His lectures were…

Just a couple of corrections. Let's take the Fundamental Theorem of Calculus as an example[0]: f'(x) = lim_{h->0} {f(x + h) - f(x)} / {h} This isn't the Fundamental Theorem of Calc…

From https://www.merriam-webster.com/dictionary/decimate Decimate is a word that often raises hackles, at least those belonging to a small but committed group of logophiles who fee…

Your intuition's not bad. The expected value for the longest run of heads in N total flips of a fair coin is around log2(N) - 1 with a standard deviation that's approximately 1.873…

Yeah, I think surrogate gradients are usually used to train spiking neural nets where the binary nature is considered an end in itself, for reasons of biological plausibility or so…

It sounds like jongjong was probably using surrogate gradients. You keep the step activation in the forward pass but replace with a smooth approximation in the backwards pass.

Very cool project. If you haven't already, for JAX and PyTorch support take a look at the Python Array API Standard, https://data-apis.org/array-api/latest/ , and see https://data-…

If I had to give a loose definition of topology, I would say that it is actually about studying spaces which have some notion of what is close and far, even if no metric exists. Th…

There are many situations where you have something you want to compute to within low number of units in the last place, that seem fairly involved, but there are very often clever m…

I think the truly surprising thing is just how well floating point numbers work in many practical applications despite how different they are from the real numbers. One could call …

https://en.m.wikipedia.org/wiki/Characteristic_function_(pro...

Wittgenstein himself states that the Tractatus is nonsense in its closing pages. My propositions are elucidatory in this way: he who understands me finally recognizes them as sense…

Check out The Science of Programming Matrix Computations by Robert A. van de Geijn and Enrique S. Quintana-Ort. Chapter 5 walks through how to write an optimized GEMM. It involves …

The Fortran implementation is just a reference implementation. The goal of reference BLAS [0] is to provide relatively simple and easy to understand implementations which demonstra…

There’s a wonderful book on the subject by Raymond Smullyan, of knights and knaves recreational math puzzle fame which helped make it click for me. https://lib.undercaffeinated.xyz…

I’ve found code generation tools a boon to my Emacs-ing because I can use them to help write Emacs lisp code for any customization I think I might need in the moment without breaki…