Discovering faster matrix multiplication algorithms with reinforcement learning

Post by matheusd » Wed, Oct 05, 2022, 6:33 PM UTC

dekhn wrote: post #52

atty wrote: post #29

Earlier quoted context omitted.

On the other hand, real world performance is really the only useful metric for matrix multiplication. I don’t really care about the theoretical performance, or the number of operations. Not disagreeing with your take that the claim is grandiose, just pointing out that finding a generalizable way to automate the improvement of what is almost certainly the most important mathematical operation a computer can do is wort…

Science proceeds at the rate by which linearly larger matrices can be decomposed in less than exponential time.

Post by HarHarVeryFunny » Wed, Oct 05, 2022, 6:50 PM UTC

Post by adalacelove » Wed, Oct 05, 2022, 6:59 PM UTC

dekhn wrote: post #39

brutusborn wrote: post #35

Earlier quoted context omitted.

I don't doubt the sentiment is true, but hasn't this kind of science always been this way? By that I mean authors inflating the importance of their work; everyone wants to be seen as having the biggest breakthroughs. When I think of dysfunction in 'science' I usually think of unfalsifiable hypothesis, the repeatability crisis in Psychology, p-hacking in Medicine, misuse of statistical methods in Economics and other e…

Scientists have long been self-promoters who desire that their theories become the dominant ones and they use many techniques to achieve this. However, the trend towards maximizing the predicted outcomes of your research really took off during the human genomics project.

Post by Nihmie » Wed, Oct 05, 2022, 7:15 PM UTC

boole1854 wrote: post #27

svnt wrote: post #15

The big claim turns out to be a little overstated. The claim: > AlphaTensor’s algorithm improves on Strassen’s two-level algorithm for the first time, to our knowledge, since its discovery 50 years ago. reduces to: > AlphaTensor discovers algorithms that outperform the Strassen-square algorithm, which is a fast algorithm for large square matrices31,32. Although the discovered algorithm has the same theoretical comple…

This is not a correct summary of the results of the paper. First, you cut out the initial part of the sentence about improving on Strassen's two-level algorithm. Here is the complete sentence: > Particularly relevant is the case of 4 × 4 matrices in a finite field, where AlphaTensor’s algorithm improves on Strassen’s two-level algorithm for the first time, to our knowledge, since its discovery 50 years ago. That is,…

Post by 613style » Wed, Oct 05, 2022, 7:30 PM UTC

elcomet wrote: post #42

loufe wrote: post #4

This is completely besides the matter, but reading "provably" in the abstract is a frank reminder of how terrible English spelling/pronounciation is. I can't imagine I'm the only well-read native English speaker who read this as "prov-ably" on first take. I don't know about most languages, but you just don't get nonsense like this in French, at least.

I don't understand your point, provably means which can be proven, is there another meaning I'm missing ?