Viewing profile — dmoura

Thank you for sharing your learnings and for your transparency! Congrats!

I prefer a SQL-like format. It’s not as complete but it cover most of the day-to-day use cases. Take a look at https://github.com/dcmoura/spyql (I am the author). Congrats on fq!

DuckDB is great! I love what you guys are building. The main gap for me is native support of JSON (lines), like you have for CSV and Parquet.

updated, thank you

Things you can do with SPyQL CLI that you can't with clickhouse local (AFAIK, top of my mind, not exhaustive): - use python code in your queries - import python libs (just install …

Author of the benchmark and of SPyQL here. ClickHouse is fantastic. Amazing performance. SPyQL is built on top of Python but still can be faster than jq and several other tools as …

This is great! I am the author of SPyQL [1]. Combining JC with SPyQL you can easily query the json output and run python commands on top of it from the command-line :-) You can do …

Thank you all for your feedback. The benchmark was updated and the fastest tool is NOT written in Python. Here are the highlights: * Added ClickHouse (written in C++) to the benchm…

Are you able to calculate aggregates, like an average?

The initial idea was to focus on cmd line tools... I added pandas for comparison, as it is one of the most used libs to work with datasets. I will either remove Pandas from the equ…

Yes, it is much faster, I will be updating the benchmark and reposting

Thank you!! :-D

Thank you Eaton! The truth is, if I was seeking to have the best performant tool I would not choose Python to start with... so performance is only a part of tools like the ones we …

Thank you!!