Pg_lakehouse: Query Any Data Lake from Postgres

Post by snthpy » Tue, May 14, 2024, 9:11 PM UTC

nathanwallace wrote: post #56

snthpy wrote: post #55

Earlier quoted context omitted.

I like steampipe but found the use of postgres a bit heavy for my use cases. Could you make it run with pg_lite in wasm or DuckDB?

In addition to Postgres FDWs, Steampipe plugins are also available as a SQLite extension [1] or a CLI export tool [2] for lighter weight use cases. (Although a local Postgres has a surprisingly small footprint!) Building plugins as DuckDB extensions would be cool too, but we haven't done that yet. 1 - https://steampipe.io/blog/2023-12-sqlite-extensions 2 - https://steampipe.io/blog/2023-12-steampipe-export

Post by oulu2006 » Wed, May 15, 2024, 7:54 AM UTC

pid-1 wrote: post #47

whalesalad wrote: post #41

How many folks here struggle to adopt tooling like this because it isn’t possible to add psql extensions to places like RDS?

Moreover, even when extensions are supported by RDS, they often make upgrading database versions a PITA.