Live data from Hacker News

Databricks to Buy Data-Management Startup Tabular

wsj.com

21–23 of 23 posts

Re: Databricks to Buy Data-Management Startup Tabular

#22
post #19

Earlier quoted context omitted.

Hi, in case you did not find the answer yet. In my hamble opinion: - choose Iceberg: If you have several computing/query engines other than Spark, like Presto, Flink. Iceberg has a great extraction and design for a engine-independent table format. But its learning cost is relative high - choose Delta: If you only have Spark and would like to be deeply binded with Databricks - choose Hudi: If you would like to use dat…

Thank you! Sounds like iceberg is the best then. I'm very allergic to lock-in. Currently we're very Spark heavy and our query engine is AWS Redshift Serverless. The recent AWS Glue Catalog support for Iceberg seems to make this promising.

I heard from a AWS worker that they consider Iceberg to be the future. A lot of their services will be glued together with it.

Re: Databricks to Buy Data-Management Startup Tabular

#23
post #9

So, will Databricks deprioritize Delta Lake in favor or Iceberg, or will they try to derail Iceberg development now they they got the team that originally built it at Netflix? Edit: from the Tabular CEO announcement Databricks reached out to me and proposed a collaboration that could bring Iceberg and Delta closer together [...] I’m excited to have the opportunity to work with Databricks and the broader Delta communi…

At the Databricks Summit keynote this morning they pitched it as a way of trying to standardize and bridge across the two more easily, with neither going away.
Post reply on HN