9 months ago! https://tabular.io/blog/the-case-for-independent-storage/
it was an amazing sales pitch though
21–23 of 23 posts
9 months ago! https://tabular.io/blog/the-case-for-independent-storage/
it was an amazing sales pitch though
Earlier quoted context omitted.
Hi, in case you did not find the answer yet. In my hamble opinion: - choose Iceberg: If you have several computing/query engines other than Spark, like Presto, Flink. Iceberg has a great extraction and design for a engine-independent table format. But its learning cost is relative high - choose Delta: If you only have Spark and would like to be deeply binded with Databricks - choose Hudi: If you would like to use dat…
Thank you! Sounds like iceberg is the best then. I'm very allergic to lock-in. Currently we're very Spark heavy and our query engine is AWS Redshift Serverless. The recent AWS Glue Catalog support for Iceberg seems to make this promising.
So, will Databricks deprioritize Delta Lake in favor or Iceberg, or will they try to derail Iceberg development now they they got the team that originally built it at Netflix? Edit: from the Tabular CEO announcement Databricks reached out to me and proposed a collaboration that could bring Iceberg and Delta closer together [...] I’m excited to have the opportunity to work with Databricks and the broader Delta communi…