Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

github.com

Post reply on HN
Print view View original

51–60 of 109 posts

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#51

Post by password4321 »

shortrounddev wrote: post #42
wankle wrote: post #33

Earlier quoted context omitted.

No thank you. I appreciate the power, speed, simplicity and flexibility of UNIX/GNU style text tools. I-Also-Don't-Want-To-Be-Locked-Into-This-Ridiculous-Syntax-Nightmare.

It's funny to me that people hate how verbose posh is when bash syntax looks like my cat walked over my keyboard

Thank goodness for tab completion!

I appreciate that it auto-corrects capitalization and slash direction.

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#52

Post by account-5 »

networked wrote: post #40
password4321 wrote: post #20

Discussion of a similar tool last month: yq: command-line YAML, JSON, XML, CSV and properties processor https://news.ycombinator.com/item?id=34656022 Also mentions gojq, Benthos, xsv, Damsel, a 2nd yq, htmlq, cfn-flip, csvq, zq, and zsv.

I have made a repository cataloguing tools like this: https://github.com/dbohdan/structured-text-tools .

Thanks for this, good job. I always mean to do something similar but just end up bookmarking HN threads I then never look at.

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#53

Post by stinos »

shortrounddev wrote: post #42
wankle wrote: post #33

Earlier quoted context omitted.

No thank you. I appreciate the power, speed, simplicity and flexibility of UNIX/GNU style text tools. I-Also-Don't-Want-To-Be-Locked-Into-This-Ridiculous-Syntax-Nightmare.

It's funny to me that people hate how verbose posh is when bash syntax looks like my cat walked over my keyboard

When I read I-Also-Don't-Want-To-Be-Locked-Into-This-Ridiculous-Syntax-Nightmare, bash and sed and cut and the likes indeed are the first things which come to mind. I really feel kind of bad sometimes for once having spent time learning them, only to later find out there are many alternatives and nearly all of them have a shorter learning curve. Many of these tools also have zero discoverability as well, meaning you effectively get locked into learning their syntax. And then another one for the next tool. Whereas at least in PS you can try to use common words and tab completion and sometimes get there before having to reach to 'how do I x in y'.

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#55

Post by msla »

shortrounddev wrote: post #43
hobs wrote: post #19

Earlier quoted context omitted.

While powershell has gotten a lot faster in the most recent versions its still pretty slow for anything involving computation; most of the type my equivalent python code beats the pants off of it. The expressiveness is nice, but oftentimes modules won't support it or require weird ways of using the data to get the performance you want (mostly by dropping out of the pipe.) The choices around Format- vs Out- vs Convert…

My philosophy about any shell language is that if performance is a concern, then you should probably use a real programming language for it. Using shell scripting to handle batch processing tasks just creates dependencies on unmaintainable code.

If performance is too bad, you can only use the shell for toy examples, which means there's no reason to have a real shell at all and you might as well go back to COMMAND.COM or equivalent. It's taking the idea of Unix-style scriptable shells and Improving the implementation to the point of unusability.

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#56

Post by dima55 »

password4321 wrote: post #20

Discussion of a similar tool last month: yq: command-line YAML, JSON, XML, CSV and properties processor https://news.ycombinator.com/item?id=34656022 Also mentions gojq, Benthos, xsv, Damsel, a 2nd yq, htmlq, cfn-flip, csvq, zq, and zsv.

There's also https://github.com/dkogan/vnlog/ which is a wrapper around the existing coreutils, so all the options work, and there's nothing to learn

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#58

Post by nextaccountic »

password4321 wrote: post #20

Discussion of a similar tool last month: yq: command-line YAML, JSON, XML, CSV and properties processor https://news.ycombinator.com/item?id=34656022 Also mentions gojq, Benthos, xsv, Damsel, a 2nd yq, htmlq, cfn-flip, csvq, zq, and zsv.

the obvious missing reference is jq https://github.com/stedolan/jq

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#59

Post by jefftk »

networked wrote: post #40
password4321 wrote: post #20

Discussion of a similar tool last month: yq: command-line YAML, JSON, XML, CSV and properties processor https://news.ycombinator.com/item?id=34656022 Also mentions gojq, Benthos, xsv, Damsel, a 2nd yq, htmlq, cfn-flip, csvq, zq, and zsv.

I have made a repository cataloguing tools like this: https://github.com/dbohdan/structured-text-tools .

There's also GoAWK, which supports CSV natively ("-i csv"): https://github.com/benhoyt/goawk

Re: Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

#60

Post by glomgril »

networked wrote: post #40
password4321 wrote: post #20

Discussion of a similar tool last month: yq: command-line YAML, JSON, XML, CSV and properties processor https://news.ycombinator.com/item?id=34656022 Also mentions gojq, Benthos, xsv, Damsel, a 2nd yq, htmlq, cfn-flip, csvq, zq, and zsv.

I have made a repository cataloguing tools like this: https://github.com/dbohdan/structured-text-tools .

Big shouts to visidata -- very underrated tool imo.
Post reply on HN