Viewing profile — szarnyasg

Hello, DuckDB devrel here. First, thanks for the kind words :) Second, it's funny you should mention the 20-line awk script. I was making a very similar argument yesterday at the U…

Yes, Quack resolves this problem. In particular, your client (likely a DuckDB instance) will talk to a remote DuckDB that both has access to the underlying storage and can also ser…

Well, we are really working on it: https://github.com/duckdb/ducklake/pull/1151 So you'll be able to test it in a few days.

Hello, DuckDB DevRel here. Quack is independent from MotherDuck. MotherDuck has its own proprietary protocol, which has been around for years and it supports things like dual execu…

DuckDB devrel here. You are right. This was in the FAQ but I also added it to the DuckLake documentation's main page at https://ducklake.select/docs/stable/

DuckLake does not use B+ trees and it handles fragmentation with techniques like partial files and compaction upon checkpointing. The developers of DuckLake talks about this here: …

Hi, DuckDB DevRel here. To have concurrent read-write access to a database, you can use our DuckLake lakehouse format and coordinate concurrent access through a shared Postgres cat…

That's a difficult question and I would like to avoid giving a direct answer (because I co-lead a nonprofit benchmarking graph databases) but even knowing what you need for a graph…

That's a good point. I re-ran the benchmark on two instances: - c8gd.4xlarge - this has a single 950 GB NVMe SSD. - c5ad.4xlarge - this has 2 x 300 GB disks, which I put in a RAID …

Indeed, it would have been interesting but I really wanted to get the blog post out on the launch day of the MacBook Neo and did not have the bandwidth to run additional cloud expe…

You're right! I pushed an updated TL;DR block.

Yes - updates on existing rows are supported. (I work at DuckDB Labs.)

Great! > About the COPY statement, it means we can drop Parquet files ourselves in the blob storage ? Dropping the Parquet files on the blob storage will not work – you have to COP…

The YouTube video “Apache Iceberg: What It Is and Why Everyone’s Talking About It” by Tim Berglund explains data lakes really well in the opening minutes: https://www.youtube.com/w…

Yes, you can use standard SQL constructs such as INSERT statements and COPY to load data into DuckLake. (diclaimer: I work at DuckDB Labs)

AWS started offering local SSD storage up to 2 TB in 2012 (HI1 instance type) and in late 2013 this went up to 6.4 TB (I2 instance type). While these amounts don't cover all custom…

Hi, DuckDB devrel here. DuckDB is an analytical SQL database in the form factor of SQLite (i.e., in-process). This quadrant summarizes its space in the landscape: https://blobs.duc…

I'm a co-author of the blog post. I agree that the wording was confusing – apologies for the confusion. I added a note at the end: > The repository does not contain the source code…

I have observed the Makefile effect many times for LaTeX documents. Most researchers I worked with had a LaTeX file full of macros that they have been carrying from project to proj…

I am the author of the original post and I also wrote a followup blog post on it yesterday: https://szarnyasg.org/posts/duckdb-vs-coreutils/ Yes, if you break the file into parts w…

Hi – DuckDB Labs devrel here. It's great that you find DuckDB useful! On the setup side, I agree that local (instance-attached) disks should be preferred but does EBS incur an IO f…