These are two buzzwords that I still, for whatever reason, feel no momentum for.
So is data lake over now?
Dried up in 2019
Data Fabric vs. Data Mesh: What's the Difference?
11–17 of 17 posts
Re: Data Fabric vs. Data Mesh: What's the Difference?
#12They both get muddy when dropped in the Data Lake.
Re: Data Fabric vs. Data Mesh: What's the Difference?
#13Re: Data Fabric vs. Data Mesh: What's the Difference?
#14So Data Fabric is a bolt-on solution that we can't even honestly attempt today, while Data Mesh requires everyone in the engineering org to embrace data products? Sounds like startups might adopt Data Mesh, while it's easy to reorient org-level behavior, but big enterprises are doomed to carry forward their current messes until AI magically delivers us Data Fabric as a viable option. Anyone having more success with t…
[deleted]
Re: Data Fabric vs. Data Mesh: What's the Difference?
#15They both get muddy when dropped in the Data Lake.
I haven't heard of a compelling reason why the fabric and mesh are superior to the Data Lake.
Decentralized adding of data. Sure, but at the expense of giving up Enterprise wide access governance and performance. It makes me uncomfortable.
Re: Data Fabric vs. Data Mesh: What's the Difference?
#16So Data Fabric is a bolt-on solution that we can't even honestly attempt today, while Data Mesh requires everyone in the engineering org to embrace data products? Sounds like startups might adopt Data Mesh, while it's easy to reorient org-level behavior, but big enterprises are doomed to carry forward their current messes until AI magically delivers us Data Fabric as a viable option. Anyone having more success with t…
it isn't either-or. it is both.
if you view the data pipeline, you start with Data Mesh and individual teams create datasets that maintain the data for their team's domain. following that, you then get the data fabric which blends those domain specific datasets together automatically based off of the combination of a defined data model and the declared needs of consumers. a centralized team then owns those tables but not the business logic.
an example of this is Airbnb's data stack. You can read about it here: https://link.medium.com/qzqciW7Milb
Re: Data Fabric vs. Data Mesh: What's the Difference?
#17> At its core, the Data Fabric is about eliminating humans from the process as much as possible.