Essential Hadoop HDFS Commands Well Explained | Kundan Kumar |
HTML-код
- Опубликовано: 11 июн 2024
- In this video, we delve into the fundamental commands of Hadoop's HDFS (Hadoop Distributed File System) to help you manage and interact with your data efficiently. Whether you're a beginner or looking to sharpen your skills, this tutorial will guide you through the most important HDFS commands you'll need to know.
What You'll Learn:
1. Introduction to HDFS Commands: Understand the basics of HDFS and its role in the Hadoop ecosystem.
2. Listing Files and Directories: Learn how to use the hdfs dfs -ls , hdfs dfs -lsr, hdfs dfs -ls -R command to list files and directories and directory tree.
3. File Operations: Explore commands like hdfs dfs -put, hdfs dfs -get, and hdfs dfs -copyFromLocal to manage file transfers.
4. Directory Operations: Discover how to create and delete directories using hdfs dfs -mkdir and hdfs dfs -rm -r.
5. File System Checks: Understand how to check the health of your HDFS using hdfs fsck and other related commands.
Thank you for watching, and let's embark on this journey to mastering Hadoop together!
This is a fabulous tutorial indeed. please keep on giving us informative tutorials.
I am glad to know that this video tutorial was informative. Thank you dear @Joshua❤
this is a a well explained tutorial i have ever seen thank you for sharing knowledge sir
Pleasure is mine dear to share the knowledge. Welcome ❤️
Great tutorial indeed!This was so helpful.clear and concise. Thanks alot for sharing
Pleasure to know that this tutorial was so helpful and Thank you so much for saying this is one of the great tutorials dear. ❤️
The sign before the direction to put or copy to is changing from forward backslash to backward backslash . 😅
Dear Emmanuel. If I am getting you well. Are you talking about the slash sign. Like hdfs dfs -put C:\example\demo.txt /Kumar/.
1) Source we are reading the data from local machine from windows. So windows style slash
2) Destination - we are uploading to HDFS so another style slash
Hope I didn't confuse you dear. Keep learning 🥰
I found this difference:
-put: Can copy from local file systems or from other compatible file systems (like S3) to HDFS.
-copyFromLocal: Specifically designed to copy from the local file system to HDFS
also,
-put: By default, it will overwrite the destination if the file already exists.
-copyFromLocal: Will throw an error if the file already exists at the destination
However, "-put" supports more options and flags for advanced use cases
Cool. Thank you so much for the contribution dear❤️ that's what I need people should contribute in video comment
Sir, after uploading a file, it is creating 1 replication for it. i changed the hdfs-site to 2, but no change. any help?
Okay, dear. Do one thing to confirm this issue. Since you changed the replication factor, if I am not mistaken, it will only affect new data uploads, not the old data already in HDFS. So, just upload some new data to HDFS and see if it shows a replication factor of 2. Let me know if it works dear.
@@kundankumar011 it works for new uploads. thanks :)