Earlier quoted context omitted.
[flagged]
Where did he claim it is fast? As far as I can see the only claim is that it scales linearly with cores. Which it actually seems to do.
Bend: a high-level language that runs on GPUs (via HVM2)
151–160 of 269 posts
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#152Earlier quoted context omitted.
You're wrong. The Haskell code is compiled to a loop, which we didn't optimize for yet. I've edited the README to use the Bitonic Sort instead, on which allocations are unavoidable. Past N=20, HVM2 performs 4x faster than GHC -O2.
What? I ran your example, from your readme, where you promise a massive performance improvement, and you're accusing me of doing something wrong? This is exactly what a scammer would say. I guess that's the point here. Scam people who don't know anything about parallel computing by never comparing against any other method?
1. I didn't accuse you of doing something wrong, just that your claim was wrong! It has been proven that Interaction Combinators are an optimal model of concurrent computation. I also pointed cases where it also achieves practical efficiency, over-performing GHC's highest optimization level.
2. The performance scaling claimed been indeed been achieved, and the code is open for anyone to replicate our results. The machines used are listed on the repository and paper. If you find any trouble replicating, please let me know!
3. We're not selling any product. Bend is Apache-licensed.
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#153As a resident of Bend, Oregon... it was kind of funny to read this and I'm curious about the origin of the name.
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#154Re: Bend: a high-level language that runs on GPUs (via HVM2)
#155Earlier quoted context omitted.
Scaling with cores is synonym of parallel.
"Future" has some mild speed implications but it sounds like you're doing reasonably there, bug nonwithstanding.
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#156I'm excited to see how this project progresses.
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#157Ten years ago, I took a course on parallel algorithms (15-210 at CMU). It pitched parallelism as the future of computing as Moore's law would hit inevitable limits. I was sold and I was excited to experiment with it. Unfortunately, there weren't many options for general parallel programming. Even the language we used for class (SML) wasn't parallel (there was a section at the end about using extensions and CUDA but i…
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#158Earlier quoted context omitted.
> it is allocating 2 IC nodes for each numeric operation, while Python is not While that's true, Python would be using big integers (PyLongObject) for most of the computations, meaning every number gets allocated on the heap. If we use a Python implementation that would avoid this, like PyPy or Cython, the results change significantly: % cat sum.py def sum(depth, x): if depth == 0: return x else: fst = sum(depth-1, x…
The only claim I made is that it scales linearly with cores. Nothing else! I'm personally putting a LOT of effort to make our claims as accurate and truthful as possible, in every single place. Documentation, website, demos. I spent hours in meetings to make sure everything is correct. Yet, sometimes it feels that no matter how much effort I put, people will just find ways to misinterpret it. We published the real be…
Thank you. I understand in such an early irritation of a language there are going to be lots of bugs.
This seems like a very, very cool project and I really hope it or something like it is successful at making utilizing the GPU less cumbersome.
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#159Every time I try to write shaders, or even peek through my fingers at CUDA C(++) code, I recoil in disbelief that we don't have high level programming yet on the GPU. I can't wait until we do. The more great projects attacking it the better in my book.
Re: Bend: a high-level language that runs on GPUs (via HVM2)
#160Ten years ago, I took a course on parallel algorithms (15-210 at CMU). It pitched parallelism as the future of computing as Moore's law would hit inevitable limits. I was sold and I was excited to experiment with it. Unfortunately, there weren't many options for general parallel programming. Even the language we used for class (SML) wasn't parallel (there was a section at the end about using extensions and CUDA but i…
Nowadays 210 is actually parallel! You can run 210-style code using MaPLe ( https://github.com/MPLLang/mpl ) and get competitive performance with respect to C/C++. If you liked 210, you might also like https://futhark-lang.org/ which is an ML-family language that compiles to GPU with good performance.