Data Mesh Journey

Data mesh is new paradigm shift for Analytical Data Management and use at scale irrespective of complex Business and ever changing business cases. Four principles of Data Mesh

1. Domain oriented design
2. Data as Product
3. Self service platform
4. Federated Governance

Of all the principles Federated Governance is most challenging one. For scenarios of more than 1000 plus DataProducts, major challenge lie in the connection, collaboration within and between Domain team.

Using ELT, data engineers ingest Data to cloud to create source aligned Data productts. ELT tools inject transactional Data from erp or crm or finance systems via standard API to Cloud storage/lake. These transactional Data loose context.