Live data from Hacker News

DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

duckdb.org

11–20 of 54 posts

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#11
post #4

duckdb is a generational technology innovation. insanely good ergonomics, great performance, it's awesome.

Can confirm: together with `dbt` and `rill` I'm able do to [this]( https://github.com/idesis-gmbh/GitHubExperiments/blob/master... ) on my laptop.

Why did you pick rill?

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#12

DuckDB also runs in Excel, by the way, via the free xlwings Lite add-in that you can install from the add-in store. It’s using the Python package and allows to write scripts, custom functions, as well as use a Jupyter-like notebook workflow.

If you start with Excel, I'll counter with Postgres: https://github.com/duckdb/pg_duckdb. I haven't found the time to check this on one of our installation, though.

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#13
post #11
post #4

Earlier quoted context omitted.

Can confirm: together with `dbt` and `rill` I'm able do to [this]( https://github.com/idesis-gmbh/GitHubExperiments/blob/master... ) on my laptop.

Why did you pick rill?

It is a educational/R&D type project. We are more of backend developers and `rill` worked fine as a rapid visualization frontend with low learning curve for us.

Edit: still realizing that I can't use markdown on HN...

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#14
post #4

duckdb is a generational technology innovation. insanely good ergonomics, great performance, it's awesome.

Can confirm: together with `dbt` and `rill` I'm able do to [this]( https://github.com/idesis-gmbh/GitHubExperiments/blob/master... ) on my laptop.

is rill open source?

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#16

duckdb is a generational technology innovation. insanely good ergonomics, great performance, it's awesome.

I got introduced to it by Claude the other day as I was interrogating several GB of public csv files. Seemed magical as it out them all in parquet files and transformed what I needed into the normalized sqllite for my server. Coding agents seen quite comfortable with it!

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#18

Did they finally enable full SIMD or keep insisting its okay not to have it?

fwiw:

"Performance Does DuckDB use SIMD? DuckDB does not use explicit SIMD (single instruction, multiple data) instructions because they greatly complicate portability and compilation. Instead, DuckDB uses implicit SIMD, where we go to great lengths to write our C++ code in such a way that the compiler can auto-generate SIMD instructions for the specific hardware. As an example why this is a good idea, it took 10 minutes to port DuckDB to the Apple Silicon architecture."

https://duckdb.org/faq

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#19

Data engineer here: I use this all the time. It's amazing. For most of the data the sizes we often deal with it's perfect.

> For most of the data the sizes we often deal with it's perfect.

Interested here: for me it works for out of core work. Where is the limit? On a related note: do you need to handle concurrency restrictions?

Re: DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

#20

Did they finally enable full SIMD or keep insisting its okay not to have it?

Hm, our internal benchmarking shows something like a 30x speedup compared to SQLite (https://github.com/ClickHouse/ClickBench shows an even greater speedup due to not considering cache size). Calculating back on the envelope I'd estimate 8x for multithreading and 4x for SIMD. Should we expect even more?
Post reply on HN