Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The DuckDB Local UI

duckdb.org

Post reply on HN
Print view View original

141–150 of 197 posts

Re: The DuckDB Local UI

#141

Post by radicality »

jarpineh wrote: post #47
vamega wrote: post #25

This looks pretty great. The UI looked fantastic, and the post mentioned that it was open source. However what's open source appears to be the DuckDB extension, which forwards the requests to a remote URL. I've not been able to find the code for the actual UI. Is the actual UI open source, or is that something MotherDuck is allowing to be used by this while remaining proprietary? Right now it doesn't appear like this…

The docs say that the extension's server is configured here: https://duckdb.org/docs/stable/extensions/ui#remote-url But yeah, I can't find docs nor source for the UI. And the extension docs refer to MotherDuck's own UI: https://motherduck.com/docs/getting-started/motherduck-quick... So, a bit confusing way this is set up.

It’s quite funny the docs also say this about the configurable url:

> Be sure you trust any URL you configure, as the application can access the data you load into DuckDB.

That’s certainly not what I would expect if someone gave me a “local UI” for some database. I’ve only just once toyed with duckdb, was planning to look more at it - looks like will need to have my guard and see what actually is “local” and doesn’t ship my data to a remote url.

Re: The DuckDB Local UI

#142

Post by westurner »

miked98 wrote: post #137
fenghorn wrote: post #131

The UI aesthetics look similar to the excellent Rill, also powered by DuckDB: https://www.rilldata.com/ Rill has better built in visualizations and pivot tables and overall a polished product with open-source code in Go/Svelte. But the DuckDB UI has very nice Jupyter notebook-style "cells" for editing SQL queries.

Rill founder here, I have no comment on the UI similarity :) but I would emphasize our vision is building DuckDB-powered metrics layers and exploratory dashboards -- which we presented at DuckCon #6 last month, PDF below [1] -- and less on notebook style UIs like Hex and Jupyter. Rill is fully open-source under the Apache license. [2] [1] https://blobs.duckdb.org/events/duckcon6/mike-driscoll-rill-... [2] https://git…

WhatTheDuck does SQL with duckdb-wasm

Pygwalker does open-source descriptive statistics and charts from pandas dataframes: https://github.com/Kanaries/pygwalker

ydata-profiling does open-source Exploratory Data Analysis (EDA) with Pandas and Spark DataFrames and integrates with various apps: https://github.com/ydataai/ydata-profiling #integrations, #use-cases

Re: The DuckDB Local UI

#143

Post by klysm »

This leaves a bad taste in my mouth, because motherduck is going to try and use this to squeeze more money out of duckdb. It’s a slippery slope from here on out.

Re: The DuckDB Local UI

#144

Post by klysm »

ryguyrg wrote: post #109
ayhanfuat wrote: post #57

Earlier quoted context omitted.

> The DuckDB UI is also fully open source: visit the duckdb/duckdb-ui repository if you want to dive in deeper. Is this really the case? The repo doesn’t seem to have any ui elements?

We updated the video [if that's the reference], because it is not yet open source. Thanks for pointing that out!

Is it going to be open source?

Re: The DuckDB Local UI

#145

Post by ayuhito »

klysm wrote: post #143

This leaves a bad taste in my mouth, because motherduck is going to try and use this to squeeze more money out of duckdb. It’s a slippery slope from here on out.

To me, Motherduck have so far been excellent stewards for DuckDB. I want them to find a sustainable business model.

I doubt they’ll ever enshittify DuckDB core. It’s clear they’re only aiming for better integration with their paid service via peripherals like UI to improve the experience, but you also don’t need to use it?

It’s all extensions that you can develop the end.

Re: The DuckDB Local UI

#147

Post by frankc »

memset wrote: post #64
vamega wrote: post #25

This looks pretty great. The UI looked fantastic, and the post mentioned that it was open source. However what's open source appears to be the DuckDB extension, which forwards the requests to a remote URL. I've not been able to find the code for the actual UI. Is the actual UI open source, or is that something MotherDuck is allowing to be used by this while remaining proprietary? Right now it doesn't appear like this…

The actual UI is not open source. (Someone could write an actually open source UI extension for duckdb, but that would require a lot of investment that so far only motherduck has been able to provide.)

I find the SqlLab in apache superset to be very good, and I have duckdb as a data source (anything that supports SqlAlchemy works). It works very well. To be honest, when I first saw the screenshot, I thought it was SqlLab. I haven't actually tried the duckdb ui, though.

Re: The DuckDB Local UI

#148

Post by steve_adams_86 »

drdaeman wrote: post #103
gnulinux wrote: post #48

Earlier quoted context omitted.

DuckDB is mind blowingly awesome. It is like SQLite, lightweight, embeddable, serverless, in-memory database, but it's optimized to be columnar (analytics optimized). It can work with files that are in filesystem, S3 etc without copying (it just looks at the necessary regions in the file) by just doing `select * from 's3://....something.parquet'`. It support automatic compression and automatic indexing. It can read j…

I'm sorry, I must be exceptionally stupid (or haven't seriously worked in this particular problem domain and thus lacking awareness), but I still can't figure out the use cases from this feature list. What sort of thing should I be working on, to think "oh, maybe I want this DuckDB thing here to do this for me?" I guess I don't really get the "that you want to learn something about" bit.

My dumb guy heuristic for DuckDB vs SQLite is something like:

  - Am I doing data analysis?
  - Is it read-heavy, write-light, using complex queries over large datasets?
  - Is the dataset large (several GB to terabytes or more)?
  - Do I want to use parquet/csv/json data without transformation steps?
  - Do I need to distribute the workload across multiple cores?
If any of those are a yes, I might want DuckDB

  - Do I need to write data frequently?
  - Are ACID transactions important?
  - Do I need concurrent writers?
  - Are my data sets tiny?
  - Are my queries super simple?
If most of the first questions are no and some of these are yes, SQLite is the right call

Re: The DuckDB Local UI

#149

Post by archon810 »

miked98 wrote: post #137
fenghorn wrote: post #131

The UI aesthetics look similar to the excellent Rill, also powered by DuckDB: https://www.rilldata.com/ Rill has better built in visualizations and pivot tables and overall a polished product with open-source code in Go/Svelte. But the DuckDB UI has very nice Jupyter notebook-style "cells" for editing SQL queries.

Rill founder here, I have no comment on the UI similarity :) but I would emphasize our vision is building DuckDB-powered metrics layers and exploratory dashboards -- which we presented at DuckCon #6 last month, PDF below [1] -- and less on notebook style UIs like Hex and Jupyter. Rill is fully open-source under the Apache license. [2] [1] https://blobs.duckdb.org/events/duckcon6/mike-driscoll-rill-... [2] https://git…

I love HN. Random comments about some service out there and replies are like "I am the founder" or "I wrote that".

Re: The DuckDB Local UI

#150

Post by westurner »

westurner wrote: post #142
miked98 wrote: post #137

Earlier quoted context omitted.

Rill founder here, I have no comment on the UI similarity :) but I would emphasize our vision is building DuckDB-powered metrics layers and exploratory dashboards -- which we presented at DuckCon #6 last month, PDF below [1] -- and less on notebook style UIs like Hex and Jupyter. Rill is fully open-source under the Apache license. [2] [1] https://blobs.duckdb.org/events/duckcon6/mike-driscoll-rill-... [2] https://git…

WhatTheDuck does SQL with duckdb-wasm Pygwalker does open-source descriptive statistics and charts from pandas dataframes: https://github.com/Kanaries/pygwalker ydata-profiling does open-source Exploratory Data Analysis (EDA) with Pandas and Spark DataFrames and integrates with various apps: https://github.com/ydataai/ydata-profiling #integrations, #use-cases

xeus-sqlite is a xeus kernel for jupyter and jupyterlite which has Vega visualizations for sql queries: https://github.com/jupyter-xeus/xeus-sqlite

jupyterlite-xeus installs packages specified in an environment.yml from emscripten-forge: https://jupyterlite-xeus.readthedocs.io/en/latest/environmen...

emscripten-forge has xeus-sqlite and pandas and numpy and so on; but not yet duckdb-wasm: https://repo.mamba.pm/emscripten-forge

Post reply on HN