databow: a Rust CLI to query any database with an ADBC driver
1–10 of 28 posts
Re: databow: a Rust CLI to query any database with an ADBC driver
#2Sorry, just trying to understand. Why would I use this over duckdb. duckdb already has plugins for a lot of databases. Is the syntax the advantage?
Re: databow: a Rust CLI to query any database with an ADBC driver
#3Sorry, just trying to understand. Why would I use this over duckdb. duckdb already has plugins for a lot of databases. Is the syntax the advantage?
It’s going to have a very big hill to climb if it’s playing in a space where duckdb already has a hold. Duck has probably been my favourite technology find in the last few years. Awesome tech.
I’ll still check this out though.
Re: databow: a Rust CLI to query any database with an ADBC driver
#4Sorry, just trying to understand. Why would I use this over duckdb. duckdb already has plugins for a lot of databases. Is the syntax the advantage?
It’s going to have a very big hill to climb if it’s playing in a space where duckdb already has a hold. Duck has probably been my favourite technology find in the last few years. Awesome tech. I’ll still check this out though.
I agree
Re: databow: a Rust CLI to query any database with an ADBC driver
#5Cool! But as a data engineer I don't know when I would ever use this. Getting data into a centralized place so it can be joined and queried easily is like prio 1 for any data team.
I'm sure SREs will really love me doing expensive adhoc queries against production postgres /s
I've yet to work in enterprises big enough to have multi cloud data warehouses though, maybe it's more useful in that setting?
Re: databow: a Rust CLI to query any database with an ADBC driver
#6Sorry, just trying to understand. Why would I use this over duckdb. duckdb already has plugins for a lot of databases. Is the syntax the advantage?
ClickHouse also supports a lot of data sources and has a local mode where you just use a single binary with local-only access.
Coincidentally, I wrote an article today on how I use it for similar scenarios. It can fetch from S3, multiple databases at once, and so on.
And you get all the benefits of a database when you need to join or postprocess data from multiple sources.
Re: databow: a Rust CLI to query any database with an ADBC driver
#7Cool! But as a data engineer I don't know when I would ever use this. Getting data into a centralized place so it can be joined and queried easily is like prio 1 for any data team. I'm sure SREs will really love me doing expensive adhoc queries against production postgres /s I've yet to work in enterprises big enough to have multi cloud data warehouses though, maybe it's more useful in that setting?
As a consultant data engineer (ish), I think it has potential. You're right that any company doing data analytics is gonna be prioritizing a single source of truth and a unified platform, but each one will choose a different set of tools, which I'll have to learn, install, and even teach, for each new client. If I can use this to both explore AND implement stuff for clients regardless of their underlying database, that would be a pretty significant win.
Re: databow: a Rust CLI to query any database with an ADBC driver
#8Cool! But as a data engineer I don't know when I would ever use this. Getting data into a centralized place so it can be joined and queried easily is like prio 1 for any data team. I'm sure SREs will really love me doing expensive adhoc queries against production postgres /s I've yet to work in enterprises big enough to have multi cloud data warehouses though, maybe it's more useful in that setting?
As a consultant data engineer (ish), I think it has potential. You're right that any company doing data analytics is gonna be prioritizing a single source of truth and a unified platform, but each one will choose a different set of tools, which I'll have to learn, install, and even teach, for each new client. If I can use this to both explore AND implement stuff for clients regardless of their underlying database, th…
That's a great point! "Speed to insight" feels more important than ever
Re: databow: a Rust CLI to query any database with an ADBC driver
#9[flagged]
Re: databow: a Rust CLI to query any database with an ADBC driver
#10Cool! But as a data engineer I don't know when I would ever use this. Getting data into a centralized place so it can be joined and queried easily is like prio 1 for any data team. I'm sure SREs will really love me doing expensive adhoc queries against production postgres /s I've yet to work in enterprises big enough to have multi cloud data warehouses though, maybe it's more useful in that setting?
Isn’t it useful for when you are getting things into a central DW?
E.g, you don’t need a million tools to connect to the million different application databases when inspecting sources as part of setting up pipelines.