Multiplying Matrices Without Multiplying

#1

Post by moinnadeem » Wed, Sep 01, 2021, 12:02 AM UTC

Multiplying Matrices Without Multiplying
arxiv.org

Re: Multiplying Matrices Without Multiplying

#2

Post by ausbah » Wed, Sep 01, 2021, 12:14 AM UTC

as a total outside to this sort of stuff, doesn't this have the big issue of error propagation?

Re: Multiplying Matrices Without Multiplying

#3

Post by nynx » Wed, Sep 01, 2021, 12:20 AM UTC

Huh, that’s kinda fascinating. Maybe it’d be worth running ml on matrix multiplication that’s approximated by ml?

Re: Multiplying Matrices Without Multiplying

#4

Post by TrainedMonkey » Wed, Sep 01, 2021, 12:22 AM UTC

nynx wrote: post #3

Huh, that’s kinda fascinating. Maybe it’d be worth running ml on matrix multiplication that’s approximated by ml?

Ironic thing is large part of how ML works is via matrix multiplication.

Re: Multiplying Matrices Without Multiplying

#5

Post by random314 » Wed, Sep 01, 2021, 12:37 AM UTC

Ha ha! What the hell! This is revolutionary if true!

Re: Multiplying Matrices Without Multiplying

#6

Post by r00fus » Wed, Sep 01, 2021, 12:42 AM UTC

TrainedMonkey wrote: post #4

nynx wrote: post #3

Huh, that’s kinda fascinating. Maybe it’d be worth running ml on matrix multiplication that’s approximated by ml?

Ironic thing is large part of how ML works is via matrix multiplication.

That's not ironic, it could be revolutionary for this algorithm and ML in general.

Re: Multiplying Matrices Without Multiplying

#7

Post by echelon » Wed, Sep 01, 2021, 12:44 AM UTC

ausbah wrote: post #2

as a total outside to this sort of stuff, doesn't this have the big issue of error propagation?

Probably, but hill climbing will avoid loss in the long run. The speed boost is probably more than worth it.

I wouldn't be surprised if we started using lossier math for faster state space search. Once you find a peak, you could swap out the maths to be more exact.

Re: Multiplying Matrices Without Multiplying

#8

Post by antonzabirko » Wed, Sep 01, 2021, 12:55 AM UTC

Had this same exact thought as an undergrad like 3 years ago! I kinda gave up due to the massive barrier and difficult financial burdens faced by phd students. This feels nice to know i wasn't crazy.

Re: Multiplying Matrices Without Multiplying

#9

Post by uluyol » Wed, Sep 01, 2021, 1:08 AM UTC

TrainedMonkey wrote: post #4

nynx wrote: post #3

Huh, that’s kinda fascinating. Maybe it’d be worth running ml on matrix multiplication that’s approximated by ml?

Ironic thing is large part of how ML works is via matrix multiplication.

Lots of things are like this. I program my network using a network. I run a server (BMC) on my server. I start my engine with an engine (https://en.m.wikipedia.org/wiki/Lockheed_SR-71_Blackbird).

Re: Multiplying Matrices Without Multiplying

#10

Post by jmount » Wed, Sep 01, 2021, 1:14 AM UTC

antonzabirko wrote: post #8

Had this same exact thought as an undergrad like 3 years ago! I kinda gave up due to the massive barrier and difficult financial burdens faced by phd students. This feels nice to know i wasn't crazy.

In my opinion, that is the thing with theoretical computer science. Many of the ideas are comprehendible. And if one has the opportunity to do the work: you may get the result.