The Distributed Data Mesh (2019)

#1

Post by 0asa » Thu, Mar 18, 2021, 10:24 AM UTC

The Distributed Data Mesh (2019)
martinfowler.com

Re: The Distributed Data Mesh (2019)

#2

Post by Sladik » Fri, Mar 19, 2021, 10:38 AM UTC

On the following link you can learn how Zalando implemented this concept in the real world: https://databricks.com/session_na20/data-mesh-in-practice-ho...

Re: The Distributed Data Mesh (2019)

#3

Post by timdaub » Fri, Mar 19, 2021, 10:55 AM UTC

TL;DR?

Re: The Distributed Data Mesh (2019)

#4

Post by nagarc » Fri, Mar 19, 2021, 11:32 AM UTC

timdaub wrote: post #3

TL;DR?

goodone

Re: The Distributed Data Mesh (2019)

#5

Post by bsenftner » Fri, Mar 19, 2021, 11:52 AM UTC

Just wanna say "data lakes"? Is this a real term? The buzz words are so thick, it's hard to see past the gush propaganda.

Re: The Distributed Data Mesh (2019)

#6

Post by konjin » Fri, Mar 19, 2021, 12:28 PM UTC

bsenftner wrote: post #5

Just wanna say "data lakes"? Is this a real term? The buzz words are so thick, it's hard to see past the gush propaganda.

On the bright side I'm interviewing with big corp Inc for a senior data position so just reading this is a sure fire way to get to third round.

Re: The Distributed Data Mesh (2019)

#7

Post by hermitcrab » Fri, Mar 19, 2021, 12:35 PM UTC

bsenftner wrote: post #5

Just wanna say "data lakes"? Is this a real term? The buzz words are so thick, it's hard to see past the gush propaganda.

If your data lake becomes stagnant, it becomes a data swamp.

Re: The Distributed Data Mesh (2019)

#8

Post by eternalban » Fri, Mar 19, 2021, 12:49 PM UTC

I can't distinguish between what is described and service oriented (SOA) approach:

    Discoverable
    Addressable
    Trustworthy and truthful
    Self-describing semantics and syntax
    Inter-operable and governed by global standards
    Secure and governed by a global access control

A reminder that Thoughtworks was highly influential in pushing Microservices. This may be an elaborate mea-culpa ("oops, SOA was actually more sensible") without admiting 'culpa', rehashing SOA with a set of features (above) that look awfully like those highly elaborate SOA proposals with XML and all sorts of meta-data to 'couple' these "data products' (previously called Services).

Re: The Distributed Data Mesh (2019)

#9

Post by joshuanapoli » Fri, Mar 19, 2021, 12:56 PM UTC

I think that the main point of the article is that a company’s data strategy should result in discrete data products aligned with business domains. A domain-oriented team should be responsible for each data product. Data infrastructure should cover universal data-processing concerns, but should not include business logic. These characteristics contrast with a centralized data lake, where a single organization is responsible for both the infrastructure and content of the data resource.

Re: The Distributed Data Mesh (2019)

#10

Post by Blahah » Fri, Mar 19, 2021, 1:11 PM UTC

hermitcrab wrote: post #7

bsenftner wrote: post #5

Just wanna say "data lakes"? Is this a real term? The buzz words are so thick, it's hard to see past the gush propaganda.

If your data lake becomes stagnant, it becomes a data swamp.

data eutrophication is causing mass die off of insights, while limnic data eruption is well overdue in the majority of the world's largest endorheic data basins