Session: Let’s Talk Data Contracts, Data Products, Data Mesh, and Open-Source
The Data Mesh is a massive tsunami in the data engineering world. This new(ish) concept is allowing to bring higher data quality, clearer data ownership, better governance, and more. If I had to summarize what the Data Mesh brings in two words, it would be trust & agility.
I will first introduce the data mesh and its four principles, describe the fundamental components such as data contracts. Then, I will dive into how we built (and deployed) one at my previous employer.
Open-source & open knowledge go both ways: I will share how we used Open Source and how we give back to the community.
This session is an updated talk from ATO 2022 focusing more on the project’s entire lifecycle.
Takeaways: understand what the Data Mesh brings to your data engineering organization and build your Data Mesh with Open Source tools & components.
Audience: anyone interested in the future of data engineering.
