I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.
Programming on Parallel Machines; GPU, Multicore, Clusters and More
11–20 of 36 posts
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#12Is MPI still widely used?
What would replace it?
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#13Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#14Is MPI still widely used?
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#15Earlier quoted context omitted.
The book is in C, not R
It says R there. There is even a chapter named "Why R" explaining why R was the choose language for the book.
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#16If you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU d…
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#17I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.
Fwiw, a single u-12tb1.112xlarge has 448 cores.
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#18I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.
500 cores is just a handful of nodes nowadays. Living in the future is weird.
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#19If you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU d…
How do you get started with that?
Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More
#20If you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU d…
How do you get started with that?