Awesome video - thanks. I have started our organisation's data catalog. We are using Microsoft Purview. One thing I have already realised is that it takes time to document your enterprise data in a data catalog, you have to be patient and perhaps take it one business domain at a time depending on you organisation size. Happy cataloging everyone!
Interesting video Ben, thanks ! I'm curious on what is your vision on how to do the change management with the business part of the company (subject for another video ?)
Ugggg nothing is more impotent than a data catalog. Data engineers hate it because it's not needed for replication / DE transformation , and business hates it because it puts governance around what they're trying to do . And it's in the nature of analysts to hate all kinds of governance / enforcement. Yuck.
Awesome video - thanks.
I have started our organisation's data catalog. We are using Microsoft Purview.
One thing I have already realised is that it takes time to document your enterprise data in a data catalog, you have to be patient and perhaps take it one business domain at a time depending on you organisation size.
Happy cataloging everyone!
Yeah, modern ones try to automate the process but someone always has to put in the metadata
Hey Ben, thanks for this video. I was wondering if you have good data management book recommandations?
DAMAs DMBOK isn't a bad place to start
What are your thoughts on Open Metadata? It's a interesting one to me because of recent automatic Spark Lineage (Spline) integration.
Really great videos. Learning a lot.
Glad you found it helpful!
Interesting video Ben, thanks ! I'm curious on what is your vision on how to do the change management with the business part of the company (subject for another video ?)
Great suggestion, i should do that video too!
Another great nugget Ben.
glad you liked it!
I have a question 🙋
Would it be helpful to implement data catalog for application data? (Not analytics data)?
iData is open source or just Facebook proprietary? if not, any data catalog open source to recommend?
It is not open source, most people will use datahub for the opensource side of data catalogs
LOVE THY DATA!
amen
is MS Purview a tool for Data Catalog?
purview works very similar to informatica EDC where it "scans" locations and provides a data lineage in the end--so, its in that realm
Yes. We use it in our organisation.
Yeah some people do use it for DC
What about Microsoft Purview?
If I could see an actual catalogue it will help. Can anybody help?
Ugggg nothing is more impotent than a data catalog. Data engineers hate it because it's not needed for replication / DE transformation , and business hates it because it puts governance around what they're trying to do . And it's in the nature of analysts to hate all kinds of governance / enforcement. Yuck.