This looks beautiful but we're heavily invested in s3 so I'll wait for remote support
Show HN: Parqeye – A CLI tool to visualize and inspect Parquet files
31–37 of 37 posts
Re: Show HN: Parqeye – A CLI tool to visualize and inspect Parquet files
#32Yours looks much better for your use case, but fwiw you can do it in a single command with duckdb too (but not interactive etc.): duckdb -c "from 'foo.parquet'" but maybe still useful for other formats or multi-file or remote situations
I use a little shell alias that drops me into duckdb with the file loaded into a table for interactive querying:
https://github.com/llimllib/personal_code/blob/c1a74b1b9527f...
Re: Show HN: Parqeye – A CLI tool to visualize and inspect Parquet files
#33Looks great! Another seemingly extremely similar project released in the last few days: https://github.com/raulcd/datanomy
a growing need to look inside columnar data files!
Re: Show HN: Parqeye – A CLI tool to visualize and inspect Parquet files
#34Isn't this what we have spreadsheets for?
Also allows you to do computations on the data in place.
Re: Show HN: Parqeye – A CLI tool to visualize and inspect Parquet files
#35Great! I worked a lot with parquet like 5 years ago. The frustration and tilt working with the tooling was immense. Thank you for building this, it feels like resolving some old knot in my soul.
Some kind soul made this repository then, and I found it on like the 13th page of Google while in the depths of despair. It is my most treasured GitHub star, a the shining beacon that saved me. I see it has saved 17 other people too.
https://github.com/casidiablo/parquet-tools-for-dumb-people-...
Re: Show HN: Parqeye – A CLI tool to visualize and inspect Parquet files
#36It's unfortunate that Python and R don't really have any out-of-the-box means of opening data files from arguments, but if you do this kind of stuff on a daily basis it's something that you can set up. My not directly usable examples below.
Python (uv + dataiter, but easy to modify for pandas or polars): https://github.com/otsaloma/dataiter/blob/master/bin/di-open
R (as per comment, requires also ~/.Rprofile code, nanoparquet in this case): https://github.com/otsaloma/R-tools/blob/master/r-load
Re: Show HN: Parqeye – A CLI tool to visualize and inspect Parquet files
#37Nice tool!
BTW, you can use duckdb with their ui plugin to have an interactive view of your data, not only parquet.