TextQL: Execute SQL Against CSV or TSV
github.com
TextQL: Execute SQL Against CSV or TSV
1–10 of 95 posts
Re: TextQL: Execute SQL Against CSV or TSV
#2This is cool. How does it work? I'd guess cleaning the data, and copying to SQL Lite?
Re: TextQL: Execute SQL Against CSV or TSV
#3This looks very simple and easy to use.
Are there any differences with using this instead of CSVKit?
https://csvkit.readthedocs.io/en/1.0.3/
It includes a tool called csvsql.
Example usage -
csvsql --query "select name from data where age > 30" data.csv > new.csvRe: TextQL: Execute SQL Against CSV or TSV
#4For anyone looking to do this with plain SQLite, one can import a CSV by running (in the REPL)
.mode csv
.headers on
.import my.csv tablename
Re: TextQL: Execute SQL Against CSV or TSV
#5In SQLite you can just do
sqlite> .import myfile.csv mytable
sqlite> select ...
Re: TextQL: Execute SQL Against CSV or TSV
#6In SQLite you can just do sqlite> .import myfile.csv mytable sqlite> select ... What does this tool give you that SQLite doesn't do out of the box?
Re: TextQL: Execute SQL Against CSV or TSV
#7In SQLite you can just do sqlite> .import myfile.csv mytable sqlite> select ... What does this tool give you that SQLite doesn't do out of the box?
It's discussed in the README: https://github.com/dinedal/textql#key-differences-between-te...
> sqlite import will not accept stdin, breaking unix pipes. textql will happily do so.
> textql supports quote escaped delimiters, sqlite does not.
> textql leverages the sqlite in memory database feature as much as possible and only touches disk if asked.
Re: TextQL: Execute SQL Against CSV or TSV
#8In SQLite you can just do sqlite> .import myfile.csv mytable sqlite> select ... What does this tool give you that SQLite doesn't do out of the box?
From the README:
Key differences between textql and sqlite importing
sqlite import will not accept stdin, breaking unix pipes. textql will happily do so.
textql supports quote escaped delimiters, sqlite does not.
textql leverages the sqlite in memory database feature as much as possible and only touches disk if asked.
Re: TextQL: Execute SQL Against CSV or TSV
#9For anyone looking to do this with plain SQLite, one can import a CSV by running (in the REPL) .mode csv .headers on .import my.csv tablename This does look extremely convenient, though; being able to use UNIX pipes will be a huge improvement to my workflow.
[deleted]
Re: TextQL: Execute SQL Against CSV or TSV
#10If you work with CSV a lot, then also check out xsv, "a command line program for indexing, slicing, analyzing, splitting and joining CSV files", from Andrew Gallant (burntsushi of Go and Rust fame): https://github.com/BurntSushi/xsv