DuckLake is an integrated data lake and catalog format

iampims wrote: post #5

Great idea, poor naming. If you’re aiming for a standard of sorts, tying it to a specific software by reusing its name feels counter productive. “Ducklake DuckDB extension” really rolls off the tongue /s.

[deleted]

Re: DuckLake is an integrated data lake and catalog format

#7

Post by ChrisArchitect » Tue, May 27, 2025, 2:25 PM UTC

Announcement post https://duckdb.org/2025/05/27/ducklake.html (https://news.ycombinator.com/item?id=44106691)

Re: DuckLake is an integrated data lake and catalog format

#8

Post by rtyu1120 » Tue, May 27, 2025, 2:25 PM UTC

iampims wrote: post #5

Great idea, poor naming. If you’re aiming for a standard of sorts, tying it to a specific software by reusing its name feels counter productive. “Ducklake DuckDB extension” really rolls off the tongue /s.

Quite a bummer, particularly because the main selling point is that it can be utilized with any SQL database (iiuc).

Re: DuckLake is an integrated data lake and catalog format

#9

Post by jakozaur » Tue, May 27, 2025, 2:37 PM UTC

Iceberg competitor, addressing some of its shortcomings, like blown-up metadata:

https://quesma.com/blog-detail/apache-iceberg-practical-limi...

Even Snowflake was using FoundationDB for metadata, whereas Iceberg attempts to use blob storage even for the metadata layer.

Re: DuckLake is an integrated data lake and catalog format

#10

Post by formalreconfirm » Tue, May 27, 2025, 2:40 PM UTC

rtyu1120 wrote: post #8

iampims wrote: post #5

Great idea, poor naming. If you’re aiming for a standard of sorts, tying it to a specific software by reusing its name feels counter productive. “Ducklake DuckDB extension” really rolls off the tongue /s.

Quite a bummer, particularly because the main selling point is that it can be utilized with any SQL database (iiuc).

If I understand the Manifesto correctly, the metadata db can be any SQL database but the client needs to be DuckDB + DuckLake extension no ?