Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The DuckDB Local UI

duckdb.org

Post reply on HN
Print view View original

51–60 of 197 posts

Re: The DuckDB Local UI

#51

Post by simonw »

jarpineh wrote: post #46

The UI looks nice and is by itself a welcome addition. I am somewhat at odds with it being a default extension build into DuckDB release. This still is a feature/product coming from another company than the makers of DuckDB [1], though they did announce a partnership with makers of this UI [2]. Whilst DuckDB has so far thrived without VC money, MotherDuck has (at least) 100M in VC [3]. I guess I'm wondering where the…

Reminiscent of what Deno are doing with their Deno K/V feature, which works in the open source project using SQLite but gets a big upgrade if you use it with Deno Deploy: https://til.simonwillison.net/deno/deno-kv

I'm OK with this. Commercial open source projects need a business model. I get why this can be controversial, but the ecosystem needs to find ways to fund future development and I'm willing to compromise on purity if it means people are getting paid for their work.

(Actually it looks like the UI feature may depend on loading closed source assets across the Internet? If so that changes my comfort level a lot, I'm not keen on that compromise.)

Re: The DuckDB Local UI

#52

Post by mritchie712 »

0cf8612b2e1e wrote: post #49
mritchie712 wrote: post #27

Earlier quoted context omitted.

+1 we're using Perspective in crabwalk[0] (it's like dbt specifically built for duckdb and written in rust) and it's amazing paired with duckdb. Near instant loads for hundreds of thousands of rows and you can keep everything in arrow. 0 - https://github.com/definite-app/crabwalk

Where are you using/advocating crabwalk? It does look interesting, but for the local ETL use case, I am missing the pitch on just having my own collection of SQL scripts. Presumably the all-local case needs less complexity. Unless the idea is that this will eventually support more connectors/backends and work as a full dbt replacement?

A few features:

* Built-in column level lineage (i.e. dump in 20 .sql files and crabwalk automatically figures out lineage)

* Visualize the lineage

* Clean handling of input / output (e.g. simply specify @config output and you can export results to parquet, csv, etc.)

* Tests are not yet implemented, but crabwalk will have built-in support for tests (e.g. uniqueness, joins, etc.)

we're using it in our product (https://www.definite.app/), but only for lineage right now.

Re: The DuckDB Local UI

#53

Post by xemoka »

vamega wrote: post #25

This looks pretty great. The UI looked fantastic, and the post mentioned that it was open source. However what's open source appears to be the DuckDB extension, which forwards the requests to a remote URL. I've not been able to find the code for the actual UI. Is the actual UI open source, or is that something MotherDuck is allowing to be used by this while remaining proprietary? Right now it doesn't appear like this…

Yeah, this is really concerning. The handwaving around "keeping the ui up to date" by hosting it on ui.duckdb.org instead of embedding it doesn't taste great to me.

At least it's hosted on duckdb.org and not mother duck, but I really would expect to see that source somewhere. Disappointing unless I've missed it.

Breadcrumbs in the extension src: https://github.com/duckdb/duckdb-ui/blob/963e0e4d4c6f84b2536...

Re: The DuckDB Local UI

#54

Post by simonw »

ryguyrg wrote: post #3

i’m one of the co-founders at MotherDuck. our team is building the UI in collaboration with the team at DuckDB Labs. this is a first release. we know there are going to be tons of feature requests (including @antman’s request for simple charts). feel free to chime in on this thread and we’ll keep an eye on it! meanwhile, hope you enjoy this release! we had lots of fun building it.

Is this feature open source?

Re: The DuckDB Local UI

#55

Post by simonw »

pelagicAustral wrote: post #16
nickreese wrote: post #8

This is such a needed addition! Huge duckdb fan, congrats team!

I'm a bit out of the loop here, but what's the use case for DuckDB?

On way to think about it is SQLite for columnar / analytical data.

It works great against local files, but my favorite DuckDB feature is that it can run queries against remote Parquet files, fetching just the ranges of bytes it needs to answer the query using HTTP range queries.

This means you can run eg a count(*) against a 15GB parquet file from your laptop and only fetch a few hundred KBs of data (if that).

Re: The DuckDB Local UI

#57

Post by ayhanfuat »

ryguyrg wrote: post #3

i’m one of the co-founders at MotherDuck. our team is building the UI in collaboration with the team at DuckDB Labs. this is a first release. we know there are going to be tons of feature requests (including @antman’s request for simple charts). feel free to chime in on this thread and we’ll keep an eye on it! meanwhile, hope you enjoy this release! we had lots of fun building it.

> The DuckDB UI is also fully open source: visit the duckdb/duckdb-ui repository if you want to dive in deeper.

Is this really the case? The repo doesn’t seem to have any ui elements?

Re: The DuckDB Local UI

#58

Post by ciupicri »

markhalonen wrote: post #10

I suggest https://perspective.finos.org/ for data viz to be built in. We use DuckDB paired with Perspective for client-side BI use case, and it's been great.

The online demo looks great and promising, too bad it's unusable for me. I've tried installing it with conda from conda-forge and no luck. I've tried installing it with pip, the same. I've also cloned the repository from github, tried to build it and failed, but I don't remember the details.

Why is some software so difficult to install beats me.

Re: The DuckDB Local UI

#59

Post by tobilg »

markhalonen wrote: post #10

I suggest https://perspective.finos.org/ for data viz to be built in. We use DuckDB paired with Perspective for client-side BI use case, and it's been great.

Have a look at https://sql-workbench.com eventually, as it's using DuckDB WASM & Perspective to render the query results. Let me know what you think!

Re: The DuckDB Local UI

#60

Post by 999900000999 »

ryguyrg wrote: post #3

i’m one of the co-founders at MotherDuck. our team is building the UI in collaboration with the team at DuckDB Labs. this is a first release. we know there are going to be tons of feature requests (including @antman’s request for simple charts). feel free to chime in on this thread and we’ll keep an eye on it! meanwhile, hope you enjoy this release! we had lots of fun building it.

How do you compete with Supabase ? Do you have a built in authentication system? Anything like edge functions.

I've been trying to build a small card game with Supabase and I'm sorta stuck...

Post reply on HN