Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GNU Parallel, where have you been all my life?

alexplescan.com

Post reply on HN
Print view View original

131–140 of 277 posts

Re: GNU Parallel, where have you been all my life?

#131

Post by bloopernova »

notpachet wrote: post #39
bloopernova wrote: post #4

There's a shell script version of GNU parallel that's great for CI/CD pipeline tasks. You just keep it in your repo and source it as needed. It's incredibly useful, we use it in one build to batch process a few thousand things in groups of 25. Edited to add: finally got signed in to work, you create the script via: parallel --embed > scriptname.sh It's about 14,000 lines of awesome and works on "ash, bash, dash, ksh,…

Maybe this is a silly question, but what advantage do you get from checking that huge file into VC instead of just installing parallel ahead of time on the CI images?

Not a silly question!

In this case, we don't have control over the docker images used to build our apps.

Re: GNU Parallel, where have you been all my life?

#132

Post by gorjusborg »

thomasahle wrote: post #97
dahart wrote: post #81

Earlier quoted context omitted.

> Is the author still adding the "cite me or pay 10000€" notice to the output? And calling that GPL? IIRC the citation notice was cleared by Stallman as GPL compatible. I’d be surprised if anyone’s paid, I assumed that’s rhetoric to imply the value of a citation, or lack of citation, for anyone publishing scientific works. > These are just some of the reasons I’ll never use parallel. Hey I’ve actually ranted on HN be…

> it’s not tradition to write citations for tools used to conduct research. Thia is true, but it also makes it very hard for academics and PhD students who mainly write software over papers. They get no citations and eventually have to leave academia. If we had a better practice of citing central software we use - at least the academic software that wants to be cited - we could have a more flourishing ecosystem of su…

> They get no citations and eventually have to leave academia.

You're welcome?

Seriously though, adding the citation nag to software is two wrongs not making a right.

As a software user, it isn't my fault academia hasn't figured out how to reward software contribution. If they can't figure it out, finding a greener pasture makes a lot of sense.

Re: GNU Parallel, where have you been all my life?

#134

Post by grotorea »

DiggyJohnson wrote: post #106
flanked-evergl wrote: post #105

Earlier quoted context omitted.

> IIRC the citation notice was cleared by Stallman as GPL. I really hope that whomever adjudicate these disputes regarding licence agreements doesn't care what a random person says about it.

It's disingenuous to say that Richard Stallman is a "random person" regarding the GPL.

But legally, does intention matter in either copyright or contract law? And specially someone who is neither licensee or licensor?

Re: GNU Parallel, where have you been all my life?

#135

Post by dec0dedab0de »

dahart wrote: post #112
flanked-evergl wrote: post #105

Earlier quoted context omitted.

> IIRC the citation notice was cleared by Stallman as GPL. I really hope that whomever adjudicate these disputes regarding licence agreements doesn't care what a random person says about it.

What do you mean? Stallman adjudicates the disputes.

I think disputes are handled between the author of the code and the user.

Stallman is rightfully the most prominent voice to comment on the spirit of the GPL/CopyLeft/Free Software.

Re: GNU Parallel, where have you been all my life?

#136

Post by dahart »

rlpb wrote: post #128
dahart wrote: post #81

Earlier quoted context omitted.

> Is the author still adding the "cite me or pay 10000€" notice to the output? And calling that GPL? IIRC the citation notice was cleared by Stallman as GPL compatible. I’d be surprised if anyone’s paid, I assumed that’s rhetoric to imply the value of a citation, or lack of citation, for anyone publishing scientific works. > These are just some of the reasons I’ll never use parallel. Hey I’ve actually ranted on HN be…

> and the citation notice is a one-time thing you can silence permanently This doesn't scale. Imagine if all the software you used nagged you and had their own individual methods to silence them. I don't think this would be reasonable. What makes this particular software so special?

I agree, and I think I might have even used this argument before. ;)

It does scale solely for GNU Parallel though for now, and very few other people have taken the same tack as GNU Parallel’s citation notice. Despite the potential for a slippery slope, it doesn’t seem to be happening. I’d speculate that if it did start to happen, then GNU would change their stance on what’s allowed by the license, perhaps.

Re: GNU Parallel, where have you been all my life?

#137

Post by raverbashing »

5e92cb50239222b wrote: post #41
throwaway277432 wrote: post #33

Is the author still adding the "cite me or pay 10000€" notice to the output? And calling that GPL? And still answering every xargs Stackoverflow question with "you should use GNU Parallel" instead of answering the question? That really gets old quickly when googling for xarg answers. These are just some of the reasons I'll never use parallel. xargs is perfectly fine for most usecases, and it can do everything I need…

I wanted to say 'not anymore', but it turns out that some distributions remove that message. https://gitlab.archlinux.org/archlinux/packaging/packages/pa... Debian too (thanks to iib for pointing this out) https://salsa.debian.org/med-team/parallel/-/tree/master/deb... And looks like the author is aware of both: https://gitlab.archlinux.org/archlinux/packaging/packages/pa...

    -    # *YOU* will be harming free software by removing the notice.  You  
    -    # accept to be added to a public hall of shame by removing the
    -    # line. That includes you, George and Andreas.
The Open source way of buzzing a contestant

Re: GNU Parallel, where have you been all my life?

#138

Post by pdimitar »

quickthrower2 wrote: post #19

It is sort if a shame that tools can’t figure out how to parallelize things without being herded like cattle to do so. It might be a culture thing. In .NET code I see people running things in parallel a lot within code but maybe this is less so for linux tools. Maybe functional programming style could lend to a parallel-first programming style, with heuristics to decide when it isn’t worth it.

You seem a bit behind or too invested in C# in particular. Elixir for example can run stuff in parallel with just 3-4 added lines of code added to an otherwise sequential code.

Re: GNU Parallel, where have you been all my life?

#139

Post by dec0dedab0de »

throwaway277432 wrote: post #33

Is the author still adding the "cite me or pay 10000€" notice to the output? And calling that GPL? And still answering every xargs Stackoverflow question with "you should use GNU Parallel" instead of answering the question? That really gets old quickly when googling for xarg answers. These are just some of the reasons I'll never use parallel. xargs is perfectly fine for most usecases, and it can do everything I need…

Spamming stack overflow is bullshit, but I'm fine with citations and selling exceptions.

Re: GNU Parallel, where have you been all my life?

#140

Post by dahart »

dec0dedab0de wrote: post #135
dahart wrote: post #112

Earlier quoted context omitted.

What do you mean? Stallman adjudicates the disputes.

I think disputes are handled between the author of the code and the user. Stallman is rightfully the most prominent voice to comment on the spirit of the GPL/CopyLeft/Free Software.

You’re referring to a different kind of dispute than I (and parent) was talking about. In this case, Stallman did handle the dispute about whether GNU Parallel’s citation notice conflicted with the terms of the GPL.
Post reply on HN