Parallel – A command-line CPU load balancer written in Rust

Post by perturbation » Fri, Aug 26, 2016, 4:07 PM UTC

coredog64 wrote: post #38

kstrauser wrote: post #34

Earlier quoted context omitted.

parallel is awesome for when you want to want to run a number of jobs unknown in advance, such as using it as an xargs replacement: find . -type f -name | parallel --jobs 5 process_file That will run "process_file foo" for ever file in a directory with 5 processes running in parallel.

Not being a jerk, but what does parallel bring to the table that xargs doesn't? find . -type f -name | xargs -I {} -n 1 -P 5 process_file {}

    parallel --progress --wd '.' -S '4/fourworkers@blehworker.org,8/eightworkers@eightworkers.org,2/:'  "./complicated_command --param1={1} --param2={2} ::: $(some_shellcommand_to_generate_param1_values.sh) ::: $(some_shellcommand_to_generate_param2_values.sh)

Post by sitkack » Fri, Aug 26, 2016, 4:43 PM UTC

kibwen wrote: post #40

gcr wrote: post #36

Earlier quoted context omitted.

Agreed. GNU Parallel does something similar and this is confusing. But this does claim to be a reimplementation of much of GNU Parallel's functionality. If it's compatible, maybe there isn't too much of an issue. In the interest of silly UNIXism, I hereby vote for the name "serial" instead. It's just like "more" and "less", right?

I believe it intends to support a subset of GNU parallel and be command-line compatible with that subset. And "perpendicular" would be a far better joke name, IMO. :P

Post by jntrnr » Fri, Aug 26, 2016, 4:50 PM UTC

eriknstr wrote: post #37

0xmohit wrote: post #3

Earlier quoted context omitted.

A rust beginner could also look at Jonathan Turner's lessons from solving first 12 Project Euler problems. [0] https://www.jonathanturner.org/2015/10/lessons-from-first-12...

>The owner of www.jonathanturner.org has configured their website improperly. To protect your information from being stolen, Firefox has not connected to this website. I added an exception as I pretty much always do but in case the owner of the site is around here, they might want to investigate this.

Post by ole_tange » Fri, Aug 26, 2016, 5:02 PM UTC

kibwen wrote: post #40

gcr wrote: post #36

Earlier quoted context omitted.

Agreed. GNU Parallel does something similar and this is confusing. But this does claim to be a reimplementation of much of GNU Parallel's functionality. If it's compatible, maybe there isn't too much of an issue. In the interest of silly UNIXism, I hereby vote for the name "serial" instead. It's just like "more" and "less", right?

I believe it intends to support a subset of GNU parallel and be command-line compatible with that subset. And "perpendicular" would be a far better joke name, IMO. :P

Post by ole_tange » Fri, Aug 26, 2016, 5:12 PM UTC

thealistra wrote: post #29

I always tended to autogenerate a makefile with fake goals like: g1: job1 g2: job2 and then one goal to depend on them all and I used make -j 4