Programming on Parallel Machines; GPU, Multicore, Clusters and More

#1

Post by abhi9u » Sat, Nov 18, 2023, 10:18 AM UTC

Programming on Parallel Machines; GPU, Multicore, Clusters and More
heather.cs.ucdavis.edu

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#2

Post by infocollector » Sun, Nov 19, 2023, 11:34 PM UTC

For anyone who knows both R and Python well - Request: I think it would be nice to translate this book into Python from R.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#3

Post by gauku » Sun, Nov 19, 2023, 11:53 PM UTC

infocollector wrote: post #2

For anyone who knows both R and Python well - Request: I think it would be nice to translate this book into Python from R.

The book is in C, not R

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#4

Post by jsyang00 » Mon, Nov 20, 2023, 12:52 AM UTC

Is MPI still widely used?

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#5

Post by nine_k » Mon, Nov 20, 2023, 1:23 AM UTC

jsyang00 wrote: post #4

Is MPI still widely used?

What would replace it?

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#6

Post by [deleted] » Mon, Nov 20, 2023, 1:41 AM UTC

gauku wrote: post #3

infocollector wrote: post #2

For anyone who knows both R and Python well - Request: I think it would be nice to translate this book into Python from R.

The book is in C, not R

[deleted]

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#7

Post by sweetjuly » Mon, Nov 20, 2023, 1:58 AM UTC

If you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU due to the higher clock speeds available on ASICs (if your GPU core clock is 3GHz and your FPGA design maxes out at 500MHz [which would be admirable!], the GPU has nearly 6x the number of cycles to match or beat your implementation!).

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#8

Post by JZL003 » Mon, Nov 20, 2023, 2:16 AM UTC

I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#9

Post by mateuspires » Mon, Nov 20, 2023, 2:23 AM UTC

gauku wrote: post #3

infocollector wrote: post #2

For anyone who knows both R and Python well - Request: I think it would be nice to translate this book into Python from R.

The book is in C, not R

It says R there. There is even a chapter named "Why R" explaining why R was the choose language for the book.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#10

Post by bee_rider » Mon, Nov 20, 2023, 2:30 AM UTC

JZL003 wrote: post #8

I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.

500 cores is just a handful of nodes nowadays. Living in the future is weird.