The key difference between this architecture and a conventional DWH architecture, based on datamarts, is the distributed nature of this architecture. Instead of ingesting data from different domains into a central system (losing all data ownership in the process) the idea of data mesh is to maintain the ownership by distributing the storage and analytical capabilities over all domains in a microservice environment. For me this idea is ground breaking, because it fundamentally challenges the idea of a central business intelligence platform, seperated from the business applications.
Hilarious..... oh yeah, it was some tech guy, after a late night of drinking who decided which data was put into the warehouse. Uh, no - it HAS ALWAYS BEEN the consumers (the business), or at least the funded consumer who decided what data got put into the warehouse. It's hilarious how distorted your understanding of centralized IT is. and NOW, now that we have some new methodology - the data has good quality. Dude, you be smokin' something.
Is there any place with a tutorial of how to create the federated data governance with the lake formation from different aws accounts ?
Without Lake formation, can't we achieve the data mesh architecture using Other AWS products?
AWS is selling datamart in form of data mesh. Old wine in new bottle.
Exactly this, it's like going back in time.
The key difference between this architecture and a conventional DWH architecture, based on datamarts, is the distributed nature of this architecture.
Instead of ingesting data from different domains into a central system (losing all data ownership in the process) the idea of data mesh is to maintain the ownership by distributing the storage and analytical capabilities over all domains in a microservice environment.
For me this idea is ground breaking, because it fundamentally challenges the idea of a central business intelligence platform, seperated from the business applications.
minute 17, I'd argue that a startup should not even embark on a big data endeavor in 2022.
In the name of solving an already solved problem , you just need to rename it !
A Data Domain is not the same as a Line of Business.
Hilarious..... oh yeah, it was some tech guy, after a late night of drinking who decided which data was put into the warehouse. Uh, no - it HAS ALWAYS BEEN the consumers (the business), or at least the funded consumer who decided what data got put into the warehouse. It's hilarious how distorted your understanding of centralized IT is. and NOW, now that we have some new methodology - the data has good quality. Dude, you be smokin' something.