GNU Parallel - build and execute command lines from standard input in parallel
1–10 of 37 posts
Re: GNU Parallel - build and execute command lines from standard input in parallel
#2Just tried it and got errors galore. Oh well, I'll keep trying.
Re: GNU Parallel - build and execute command lines from standard input in parallel
#3This is very cool, but a little opaque at first read... To get a quicker and digestible intro, watch the video introduction (linked on the page): http://www.youtube.com/watch?v=OpaiGYxkSuQ
Re: GNU Parallel - build and execute command lines from standard input in parallel
#4In what ways is this better than make -j?
Re: GNU Parallel - build and execute command lines from standard input in parallel
#5In what ways is this better than make -j?
Because it can be run on the command line, ad hoc. Make -j is great for pre-existing command lists and dependencies. But as the man page describes, parallel is like xargs, which I use all the time on the command line for ad hoc actions (frees me from having to write a bash loop).
Re: GNU Parallel - build and execute command lines from standard input in parallel
#6It seems like 90% of the uses for this can be taken care of with xargs:
echo "file1 file2" | xargs -P 2 gzipRe: GNU Parallel - build and execute command lines from standard input in parallel
#7It seems like 90% of the uses for this can be taken care of with xargs: echo "file1 file2" | xargs -P 2 gzip
As I understand it, xargs only runs on the local machine; GNU parallel can run on remote machines as well. So parallel is the cluster-friendly version of xargs's -P.
Re: GNU Parallel - build and execute command lines from standard input in parallel
#8It seems like 90% of the uses for this can be taken care of with xargs: echo "file1 file2" | xargs -P 2 gzip
Don't you need
echo "file1 file2" | xargs -P2 -n1 gzip
?Re: GNU Parallel - build and execute command lines from standard input in parallel
#9See also the 'push' shell: http://code.google.com/p/push/
Re: GNU Parallel - build and execute command lines from standard input in parallel
#10Would it work on a PS3 running ubuntu?