Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Programming on Parallel Machines; GPU, Multicore, Clusters and More

heather.cs.ucdavis.edu

Post reply on HN
Print view View original

21–30 of 36 posts

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#21

Post by latchkey »

fragmede wrote: post #11
JZL003 wrote: post #8

I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.

Fwiw, a single u-12tb1.112xlarge has 448 cores.

448 logical processors.

Each logical processor is a hyperthread on 224 cores.

A logical processor is the number of the processor's cores multiplied by the number of threads per core.

2 threads per core.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#22

Post by up2isomorphism »

fbdab103 wrote: post #17
fragmede wrote: post #11

Earlier quoted context omitted.

Fwiw, a single u-12tb1.112xlarge has 448 cores.

Woof, $109/hour on demand pricing (~$950k/year on demand, ~$590k/1year reserved). Super curious what a similar spec machine would retail.

The problem is you will need to hire 10 guys to use that machine well. And that easily costs you 2M a year.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#23

Post by 3abiton »

petrohi wrote: post #20
shihab wrote: post #16

Earlier quoted context omitted.

How do you get started with that?

I started by reading “Digital Design and Computer Architecture”. There’s new RISC-V edition https://a.co/d/imzGBK5 . The book starts from Boolean logic and transistor technology and goes all the way to assembly programming with everything in between. Most importantly gives great introduction to HDLs. Next I played with a bunch of hardware projects specifically targeting inexpensive Arty-A7 board to get comfortable wi…

Had a friend who fell into that black hole, it's so time consuming for peoplecwith little time

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#24

Post by pjmlp »

necheffa wrote: post #14
jsyang00 wrote: post #4

Is MPI still widely used?

MPI is industry standard at this point.

When I was in the university is what still pretty much PVM vs MPI fighting for attention.

I bet no one remembers what PVM was all about now.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#25

Post by Jtsummers »

petrohi wrote: post #20
shihab wrote: post #16

Earlier quoted context omitted.

How do you get started with that?

I started by reading “Digital Design and Computer Architecture”. There’s new RISC-V edition https://a.co/d/imzGBK5 . The book starts from Boolean logic and transistor technology and goes all the way to assembly programming with everything in between. Most importantly gives great introduction to HDLs. Next I played with a bunch of hardware projects specifically targeting inexpensive Arty-A7 board to get comfortable wi…

https://dl.acm.org/doi/book/10.5555/2815529

Their ARM edition (2015) is available for free via the ACM.

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#27

Post by formerly_proven »

fragmede wrote: post #11
JZL003 wrote: post #8

I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.

Fwiw, a single u-12tb1.112xlarge has 448 cores.

vCPUs are not cores and those are "new 2021" instances based on freakin Skylake. Yikes. Green-IT, huh?

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#29

Post by Vilian »

naitgacem wrote: post #19
shihab wrote: post #16

Earlier quoted context omitted.

How do you get started with that?

have a look into hardware descriptive languages, VHDL or verilog and go from there

How is the best way to programm with them?, IDE or LSP?

Re: Programming on Parallel Machines; GPU, Multicore, Clusters and More

#30

Post by lunfard000 »

eismcc wrote: post #12
nine_k wrote: post #5

Earlier quoted context omitted.

What would replace it?

Chapel[0] was created, in part to replace MPI in HPC communities. However, MPI remains dominant. [0] https://chapel-lang.org/

I dont expect a new PL to replace a library anytime soon.
Post reply on HN