The DuckDB Local UI
121–130 of 197 posts
Re: The DuckDB Local UI
#122Weirdly, as cool as this looks, it's a bit concerning to me. It feels like this is marking a milestone in the history of a great open source project where they are doing one or many of the following: 1) Biting off more than they can chew, 2) Putting significant effort into something that's outside of their core value proposition, 3) Leaning more in the direction of supporting things with a for profit company that gra…
you might have a point on #3, but they need to pay the bills somehow.
Re: The DuckDB Local UI
#123Anecdote. Last year I had to work with a heavy analytics process. The whole thing was 4 or 5 large steps and was written with PySpark. It was really slow and memory on my system run quite low (on a 8Gb system with a generous swap), sometimes even stopping the whole processing of the pipeline. For one heavy step we tried out DuckDB and I was blown away how performant against PySpark was. It was not only fast as hell b…
Re: The DuckDB Local UI
#124Duckdb and polars have changed my Python development completely. Great packages that can work together, excited to see this.
Re: The DuckDB Local UI
#125Re: The DuckDB Local UI
#126Re: The DuckDB Local UI
#127Re: The DuckDB Local UI
#128Earlier quoted context omitted.
The actual UI is not open source. (Someone could write an actually open source UI extension for duckdb, but that would require a lot of investment that so far only motherduck has been able to provide.)
I've looked at quite a few options, and this one (the product of a single person) is a great base, and MIT licensed: https://github.com/caioricciuti/duck-ui If you want to support a real OS UI take a look.
Re: The DuckDB Local UI
#129Weirdly, as cool as this looks, it's a bit concerning to me. It feels like this is marking a milestone in the history of a great open source project where they are doing one or many of the following: 1) Biting off more than they can chew, 2) Putting significant effort into something that's outside of their core value proposition, 3) Leaning more in the direction of supporting things with a for profit company that gra…
duckdb labs didn't make the UI, motherduck did. The extension just launches the web UI. you might have a point on #3, but they need to pay the bills somehow.
Re: The DuckDB Local UI
#130Earlier quoted context omitted.
> Spark is for when you have a hundreds of machines worth of processing to do Absolutely agree. However, most uses of Spark I've seen in my career are people thinking they have hundreds of machines worth of processing to do.
And even when you jave quite a lot of machines worth of processing some single threaded streaming of data on a single machine can still beat out any distributed framework as the the overhead of distribution is large.