Show HN: OctoSQL – Query and join multiple databases and files, written in Go
1–10 of 74 posts
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#2Hey, one of the authors here.
The motivation behind this project is that I always wanted a simple commandline tool allowing me to join data from different places, without needing to set up stuff like presto or spark. On another hand, I never encountered any tool which allows me to easily query csv and json data using SQL (which at least in my opinion is fairly ergonomic to use).
This started as an university project, but we're now continuing it as an open source one, as it's been a great success so far.
Anyways, feedback greatly requested and appreciated!
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#3Hey, one of the authors here. The motivation behind this project is that I always wanted a simple commandline tool allowing me to join data from different places, without needing to set up stuff like presto or spark. On another hand, I never encountered any tool which allows me to easily query csv and json data using SQL (which at least in my opinion is fairly ergonomic to use). This started as an university project,…
Generally, I make use of file_fdw module of Postgres to achieve this.
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#4Hey, one of the authors here. The motivation behind this project is that I always wanted a simple commandline tool allowing me to join data from different places, without needing to set up stuff like presto or spark. On another hand, I never encountered any tool which allows me to easily query csv and json data using SQL (which at least in my opinion is fairly ergonomic to use). This started as an university project,…
Generally, I make use of file_fdw module of Postgres to achieve this. https://www.postgresql.org/docs/11/file-fdw.html
Didn't know about that, thanks!
Is there a way to connect this to other databases, to basically have views of your redis/MySQL/other databases in postgres?
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#5Earlier quoted context omitted.
Generally, I make use of file_fdw module of Postgres to achieve this. https://www.postgresql.org/docs/11/file-fdw.html
Didn't know about that, thanks! Is there a way to connect this to other databases, to basically have views of your redis/MySQL/other databases in postgres?
Yes sir, that too is supported.
https://www.postgresql.org/docs/11/contrib-dblink-function.h...
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#6Really cool, thanks for sharing. You all might want to look at Apache Calcite (http://calcite.apache.org/) as well for inspiration, which has similar functionality as a subset of its features!
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#7Earlier quoted context omitted.
Didn't know about that, thanks! Is there a way to connect this to other databases, to basically have views of your redis/MySQL/other databases in postgres?
Yes sir, that too is supported. https://www.postgresql.org/docs/11/contrib-dblink-function.h...
Seems like it's solving part of the problems we're having really well, I'll have to read up more on it, thanks!
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#8Really cool, thanks for sharing. You all might want to look at Apache Calcite ( http://calcite.apache.org/ ) as well for inspiration, which has similar functionality as a subset of its features!
Looks like it's solving part or even all the same problems we are.
Will surely be researching on how they approached it.
Thanks for it! Will surely help us going forward.
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#9Thanks for sharing. This is cool, just what I wanted. I like the fact I can create config files and query not just he database but also query JSON.
Re: Show HN: OctoSQL – Query and join multiple databases and files, written in Go
#10Earlier quoted context omitted.
Yes sir, that too is supported. https://www.postgresql.org/docs/11/contrib-dblink-function.h...
Seems like it's solving part of the problems we're having really well, I'll have to read up more on it, thanks!
Sure. You might also wanna check this:
PG community extensions - https://pgxn.org/
There are a lot of open-source or free extensions to make PG as a data platform rather than just a RDBMS.