Csvkit - command line utilities for working with csv files
csvkit.readthedocs.org
Csvkit - command line utilities for working with csv files
1–10 of 18 posts
Re: Csvkit - command line utilities for working with csv files
#2Anyone know of a similar tool based on Ruby?
Re: Csvkit - command line utilities for working with csv files
#3Is there a CSV AWK?
By that i mean, something that could read the header line in a CSV and automatically generate those variables for each line.
Demonstration:
$ cat test.csv
Field1,Field2
1,2
3,4
5,6
$ csvawk '{print Field1+Field2}' test.csv
3
7
11Re: Csvkit - command line utilities for working with csv files
#4Anyone know of a similar tool based on Ruby?
Does not Ruby support pipelines?
Re: Csvkit - command line utilities for working with csv files
#5Is there a CSV AWK? By that i mean, something that could read the header line in a CSV and automatically generate those variables for each line. Demonstration: $ cat test.csv Field1,Field2 1,2 3,4 5,6 $ csvawk '{print Field1+Field2}' test.csv 3 7 11
it would probably be a pretty easy bash script to write
Re: Csvkit - command line utilities for working with csv files
#6Anyone know of a similar tool based on Ruby?
These are command line utilities, why worry about the language? Just pipe data into and out of csvkit's tools and level up!
Re: Csvkit - command line utilities for working with csv files
#7hai
h
Re: Csvkit - command line utilities for working with csv files
#8hai
h f
h f
Re: Csvkit - command line utilities for working with csv files
#9Re: Csvkit - command line utilities for working with csv files
#10Mucking around with CSV files in command-line is painful. Been there, done that, got annoyed by many limitations of that approach, bit the bullet and learned R. It is somewhat weird language, but it was one of the best decisions I ever made in my professional career: now it is my go-to tool for data analysis and plotting.
CSV data is easily imported into R where you can easily analyze it, transform it, plot it -- everything from a unified command-line interface (there also exist GUIs, but I haven't used them). reshape and plyr packages are worth learning too. There's also an emacs package for interacting with R (ESS), and it significantly eases interaction; works also under Win, and is what I use in my work with R.
TL;DR: nice project, but it's a toy compared to what you can get from R. (Re unix philosophy: I'm the type of person that likes to get the job done and I therefore very often choose pragmatism over idealism.)