Thanks Naval for creating such powerful video. You have explained the things so easily that everyone would able to understand all concepts very easily. Great Going Naval.
Just adding a point in external table data is external and metadata is in databrick when we drop the table only meta data will be deleted ,data is safe in ADSL
You're very welcome! I'm delighted to hear that you found the explanation helpful. If you ever have more questions or need further clarification on anything, please don't hesitate to ask. Thanks for watching, and I appreciate your support! 😊👍
@@Ajjeshh correct me if im wrong Dropping Table: When you drop a managed Delta table, both the table metadata and data are deleted from the storage layer. However, when you drop an unmanaged Delta table, only the table metadata is deleted, and the data remains intact in the external storage layer. Therefore, you need to be careful when dropping unmanaged tables, as you could lose your data if you’re not careful.
Just a small confusion. In hive i studied that if internal gets dropped both data and metadata get deleted. but if we drop external only meta data get deleted the actuall is stored in hdfs/s3/adls. but here u r saying for external if we drop this meta data wont get deleted only data get deleted. I did not get this plz explain
When you drop an external table, the table gets dropped from the hive metastore, i.e. you lose the schema definition for the table, but the external location still has your data in parquet format along with metadata (your transaction logs in json format and your history).
Nice explanation. One correction for external tables only the metadata gets deleted from your external location that can be your S3 or ADLS. Still you can access to the data.
When you drop an external table, Databricks removes the table metadata but leaves the underlying data in the external location intact. correct me If I am wrong.
For an external table, when the drop command is issued, metadata is deleted, data is still there in adls/storage. for a managed table, both data and metadata are deleted. Correct me if I am wrong.
Thank you for your feedback! I’ve actually improved the audio quality in my recent videos and will continue to keep the mic closer for even better sound. I appreciate your support and suggestions-thanks for watching!
Lake House is more than delta. Its open meaning open technology, its the same treatment and technology for streaming and batch ie not lambda or kappa. Ect ..
so much helpful video sir keep suporting...
Thank You 🙏
Glad it helped you. 😊
I mentioned in your other video also.. you explained very well, specially ""what and where"" all components exists..
Thanks for your kind words! I'm glad you found the explanation helpful. If you have any more questions, feel free to ask!
Thanks Naval for creating such powerful video. You have explained the things so easily that everyone would able to understand all concepts very easily. Great Going Naval.
Best explanation about delta thanks
Just adding a point in external table data is external and metadata is in databrick
when we drop the table only meta data will be deleted ,data is safe in ADSL
You explained it very well Sir.
thanks for your efforts
Thank you very much brother..
Thank you so much for your kind words! 😊 We're thrilled to hear that you're enjoying our content.
very well explained Thank you😊
You're very welcome! I'm delighted to hear that you found the explanation helpful. If you ever have more questions or need further clarification on anything, please don't hesitate to ask. Thanks for watching, and I appreciate your support! 😊👍
Best explanation bro..I have seen lot of videos but you explained in a very simple way.Thank you.
Very helpful video 👍
Well explained video.. helped to clear lots of concepts thanks
Thank you so much for such granular details🎉
You're very welcome! I'm glad you found the details helpful 🎉.
Incorrect information at 30:02. When an external table is dropped, only the metadata is deleted. Data stays.
Nope.
When an external table is dropped, data only gets dropped but metadata always stays as we are storing outside dbfs ..
r u sure??@@Ajjeshh
@@Ajjeshh correct me if im wrong Dropping Table: When you drop a managed Delta table, both the table metadata and data are deleted from the storage layer. However, when you drop an unmanaged Delta table, only the table metadata is deleted, and the data remains intact in the external storage layer. Therefore, you need to be careful when dropping unmanaged tables, as you could lose your data if you’re not careful.
Just a small confusion. In hive i studied that if internal gets dropped both data and metadata get deleted.
but if we drop external only meta data get deleted the actuall is stored in hdfs/s3/adls.
but here u r saying for external if we drop this meta data wont get deleted only data get deleted.
I did not get this plz explain
When you drop an external table, the table gets dropped from the hive metastore, i.e. you lose the schema definition for the table, but the external location still has your data in parquet format along with metadata (your transaction logs in json format and your history).
Much appreciated
You're most welcome! If you have any more questions or need assistance in the future, don't hesitate to ask.
Nice explanation. One correction for external tables only the metadata gets deleted from your external location that can be your S3 or ADLS. Still you can access to the data.
When you drop an external table, Databricks removes the table metadata but leaves the underlying data in the external location intact. correct me If I am wrong.
Correct
For an external table, when the drop command is issued, metadata is deleted, data is still there in adls/storage. for a managed table, both data and metadata are deleted. Correct me if I am wrong.
You're absolutely right!
Thanks sir 😅
Glad it helped you.
thanks
You're welcome!
Could you please make a video how to read delta tables in powerbi ?
Check out my video on connecting it to Power BI
ruclips.net/video/IOSVRkguuHg/видео.htmlsi=t-TGk0lgMijHSMLs
Is it mandatory for databricks you should have handson experience of 6months
Your content is good but sometime audio quality is not good. Please work on it. Keep closer to mic every time.
Thank you for your feedback! I’ve actually improved the audio quality in my recent videos and will continue to keep the mic closer for even better sound. I appreciate your support and suggestions-thanks for watching!
Lake House is more than delta. Its open meaning open technology, its the same treatment and technology for streaming and batch ie not lambda or kappa. Ect ..
cleared major dought at 36:00 thak you