Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Finite Field Assembly: A Language for Emulating GPUs on CPU

leetarxiv.substack.com

Post reply on HN
Print view View original

21–30 of 35 posts

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#21

Post by saghm »

almostgotcaught wrote: post #16
muragekibicho wrote: post #2

Introduction : Finite Field Assembly is a programming language that lets you emulate GPUs on CPUs It's a CUDA alternative that uses finite field theory to convert GPU kernels to prime number fields. Finite Field is the primary data structure : FF-asm is a CUDA alternative designed for computations over finite fields. Recursive computing support : not cache-aware vectorization, not parallelization, but performing a ca…

> I'm getting my math PhD and I built this language around my area of expertise, Number Theory and Finite Fields. Your LinkedIn says you're an undergrad that took a gap year 10 months ago (before completing your senior year) to do sales for a real estate company.

Depending on what properties they sold, they certainly could have gotten valuable real-world expertise with finite fields. It's certainly easier to sell them than infinite ones!

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#22

Post by pizza »

Conscat wrote: post #17
pizza wrote: post #9

Earlier quoted context omitted.

This is phrased in a kind of demanding way to an author who has been kind enough to share their novel work with us. Are you sure you spent enough time trying to understand?

It seems that pretty much everybody here is confused by this article. One user even accused it of LLM plagiarism, which is pretty telling in my opinion. I for one have no clue what anything I read in there is supposed to mean. Emulating a GPU's semantics on a CPU is a topic which I thought I had a decent grasp on, but everything from the stated goals at the top of this article to the example code makes no sense to me…

It just seems like residue numbering systems computation, which I'm already working with.

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#23

Post by pizza »

almostgotcaught wrote: post #16
muragekibicho wrote: post #2

Introduction : Finite Field Assembly is a programming language that lets you emulate GPUs on CPUs It's a CUDA alternative that uses finite field theory to convert GPU kernels to prime number fields. Finite Field is the primary data structure : FF-asm is a CUDA alternative designed for computations over finite fields. Recursive computing support : not cache-aware vectorization, not parallelization, but performing a ca…

> I'm getting my math PhD and I built this language around my area of expertise, Number Theory and Finite Fields. Your LinkedIn says you're an undergrad that took a gap year 10 months ago (before completing your senior year) to do sales for a real estate company.

Why bother doing a witch hunt and leaving out that they did Stats at Yale..

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#24

Post by almostgotcaught »

pizza wrote: post #23
almostgotcaught wrote: post #16

Earlier quoted context omitted.

> I'm getting my math PhD and I built this language around my area of expertise, Number Theory and Finite Fields. Your LinkedIn says you're an undergrad that took a gap year 10 months ago (before completing your senior year) to do sales for a real estate company.

Why bother doing a witch hunt and leaving out that they did Stats at Yale..

Because why does it matter? Are you suggesting undergrad stats at Yale is comparable to a PhD in number theory?

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#26

Post by petermcneeley »

vimarsh6739 wrote: post #19

One of the more subtle aspects of retargeting GPU code to run on the CPU is the presence of fine grained(read - block level and warp level) explicit synchronization mechanisms being available in the GPU. However, this is not the same in CPU land, so additional care has to be taken to handle this. One example of work which tries this is https://arxiv.org/pdf/2207.00257 . Interestingly, in the same work, contrary to wh…

A single CPU thread should be treated as basically a warp executing 4 simd vectors in parallel. The naïve implementation of __syncthreads() would be an atomic mechanism shared across all threads that contribute to what is GPU workgroup.

Looks like this entire paper is just about how to move/remove these barriers.

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#27

Post by markisus »

adamvenis wrote: post #12

I think I get it. You're using the Ring isomorphism from the Chinese Remainder Theorem to do "parallel computation". This is the same principle as how boolean algebra on binary strings computes the pairwise results of each bit in parallel. Unfortunately, there's no free lunch - if you want to perform K operations on N-bit integers in parallel, you still need to work with (K * N)-bit-wide vectors, which is essentially…

I’m also unsure where finite fields are coming into play. Finite fields have orders that are prime powers, and the author is talking about a “finite field” of order 7x9x11. But if we aren’t dealing with fields, why is the author mentioning plans for implementing division? It definitely needs more explanation but I’m not sure if the idea is coherent.

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#28

Post by pizza »

almostgotcaught wrote: post #24
pizza wrote: post #23

Earlier quoted context omitted.

Why bother doing a witch hunt and leaving out that they did Stats at Yale..

Because why does it matter? Are you suggesting undergrad stats at Yale is comparable to a PhD in number theory?

I guess it's not clear to me why it's even interesting to talk about their LinkedIn or their PhD in the first place? It's not like not having a PhD will make the work any more true or not. Wouldn't it be more interesting to discuss the merits of the post? There's really little point in trying to say that their LinkedIn has different info than the comment therefore the submission is invalid.

But, suppose I did actually hold that belief for some reason, then it would seem fairly intellectually dishonest to withhold relevant info in my pointed inquisition wherein I just characterize them as someone lacking mathematical experience at all, let alone from a world class university. But maybe that's just me!

Re: Finite Field Assembly: A Language for Emulating GPUs on CPU

#30

Post by markisus »

pwdisswordfishz wrote: post #25

> Field order (the number of elements your field can hold). i.e you can store 8 * 9 * 11 elements in the field I thought a finite field's order has to be a prime power.

Yes you are right. According to Wikipedia it was proven in 1893. https://en.wikipedia.org/wiki/Finite_field

I’m dubious of this project.

Post reply on HN