Live data from Hacker News

Programming on Parallel Machines; GPU, Multicore, Clusters and More

heather.cs.ucdavis.edu

11–20 of 36 posts

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#11
post #8

I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.

Fwiw, a single u-12tb1.112xlarge has 448 cores.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#15
post #3

Earlier quoted context omitted.

The book is in C, not R

It says R there. There is even a chapter named "Why R" explaining why R was the choose language for the book.

Page 321 goes into how to translate R things to C/C++ things. It’s trivial to do the same for python. ChatGPT could do it.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#16

If you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU d…

How do you get started with that?

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#17
post #8

I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.

Fwiw, a single u-12tb1.112xlarge has 448 cores.

Woof, $109/hour on demand pricing (~$950k/year on demand, ~$590k/1year reserved). Super curious what a similar spec machine would retail.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#18
post #8

I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.

500 cores is just a handful of nodes nowadays. Living in the future is weird.

If you count hyperthreads as cores, AMD 9754 dual socket is 512 in one node.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#19
post #16

If you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU d…

How do you get started with that?

have a look into hardware descriptive languages, VHDL or verilog and go from there

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#20
post #16

If you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU d…

How do you get started with that?

I started by reading “Digital Design and Computer Architecture”. There’s new RISC-V edition https://a.co/d/imzGBK5. The book starts from Boolean logic and transistor technology and goes all the way to assembly programming with everything in between. Most importantly gives great introduction to HDLs. Next I played with a bunch of hardware projects specifically targeting inexpensive Arty-A7 board to get comfortable with FPGA tooling.
Post reply on HN