How to Install Hadoop on Ubuntu in VirtualBox | Ubuntu tutorials | Data Engineering | IvyProSchool

Поделиться
HTML-код
  • Опубликовано: 4 авг 2024
  • In this video, we'll start by addressing a common query-how to dynamically adjust the window size of a #virtualbox . I'll guide you through inserting the Guest Additions CD Image, installing the necessary additions, and configuring your system for flexible window resizing.
    Next comes the main focus: installing Apache #hadoop . I'll guide you step by step, from downloading the Hadoop binary version 3.2.4 to configuring the environment and launching your Hadoop cluster.
    By the end of this tutorial, you'll have a functional Hadoop setup on your #ubuntu VirtualBox environment, ready to tackle big data processing and analysis tasks. #hadooptutorial
    #commands for Hadoop configurations -
    docs.google.com/document/d/1q...
    00:00:00 - 00:00:20 Introduction
    00:00:21 - 00:02:40 Manage VirtualBox Window
    00:02:41 - 00:03:51 Installing Hadoop
    00:03:52 - 00:04:32 Installing Java
    00:04:33 - 00:05:11 Create Datanode and namenode folder
    00:05:12 - 00:09:38 creating the bash commands
    00:09:39 - 00:13:48 Configure hadoop in ubuntu
    00:13:49 - 00:14:00 Format namenode
    00:14:01 - 00:15:44 Configure ssh
    00:15:45 - 00:16:36 Starting datanode and namenode
    00:16:37 - 00:16:48 Conclusion
    ❓Interested in a Data Science or Data Engineering career? Check out the Ivy Pro School’s top ranked Nasscom, Govt. of India and IBM accredited Data Science and Data Engineering courses: ivyproschool.com/
    ❓Why should you learn Data Science today? • Future Of Analytics & ...
    ❓Are you a Fresher? Watch this video to know the Data Science Journey for Freshers: • Data Science Journey f...
    ✅Don’t forget to Subscribe to Ivy Pro School’s RUclips Channel: / @ivyproschool
    ✅Learn from Ivy Pro School’s Data Science and Data Engineering Students’ Success Stories : • Student Success Story
    Liked the video? Check out below more playlists on Data Science and Data Engineering learning tutorial, alumni interview experiences, live data science case studies,etc:
    ⏩Students Share Interview Experiences- • Student Interview Expe...
    ⏩Data Cleaning using excel- • Data Cleaning using Excel
    ⏩SQL Interview questions solved in Hindi - • Sql Interview Question...
    ⏩PowerBI Tutorials - • Power BI Tutorial
    ⏩Industry case studies and projects by students - • Industry Case Studies ...
    ⏩Data Science for Beginners - • Data Science for Begin...
    ⏩Excel VBA tutorial - • Excel VBA Tutorial
    ⏩Excel Tutorials by Eeshani Agrawal - • Excel for Beginners
    ⏩Tableau Tutorials by Eeshani Agrawal - • Tableau Tutorial by Ee...
    For more updates on courses and tips don’t forget to follow us on:
    - Instagram: / ivyproschool
    - LinkedIn: / ivy-professional-school
    - Facebook: / ivyproschool
    - Twitter: / ivyproschool
    - Telegram: t.me/learndswithexperts
    Want to take a Data Science Course with Ivy Professional School - visit us at ivyproschool.com You can call us at +91-7676882222 or mail to info@ivyproschool.com.

Комментарии • 50

  • @bhadrinarayanan9660
    @bhadrinarayanan9660 6 месяцев назад +1

    For 4 days I was not able to install hadoop but after your video i installed it successfully

  • @harshithvkumar4463
    @harshithvkumar4463 10 месяцев назад

    Great tutorial, thank you very much

  • @chandramouli1330
    @chandramouli1330 Месяц назад +1

    Great, thanks for the video

  • @twobrothers2083
    @twobrothers2083 3 месяца назад +1

    thqnk you dude for this usefull video I zish you all good this world can provide

  • @hafsa8010
    @hafsa8010 9 месяцев назад

    Thaaaank you a looooot ❤

  • @okumujustine
    @okumujustine 6 месяцев назад

    Nice, worked for me, thank you

  • @09_annandakurniawan_ti66
    @09_annandakurniawan_ti66 4 месяца назад +1

    livesaver! thankyou so much you helped me a lot!

  • @martinz6788
    @martinz6788 Месяц назад

    THANKS I LOVE YOU 😭😭😭

  • @eikescudellari4904
    @eikescudellari4904 6 месяцев назад +1

    Thanks bro, awesome video

  • @AboQusai212
    @AboQusai212 5 месяцев назад +3

    Thank you for this great video. However, only the last step did not work with me "Unable to connect". what could be the problem?

    • @IvyProSchool
      @IvyProSchool  4 месяца назад

      First uninstall SSH, then follow configure the SSH section on the video after that install SSH.

  • @CristianDamianCastilloAcero
    @CristianDamianCastilloAcero Месяц назад

    Hola hice todo el procedimiento pero cuando me voy a conectar desde el navegador no me lo permite

  • @onlyhuman5669
    @onlyhuman5669 7 месяцев назад +1

    Perfect tutorial

  • @hoangg9271
    @hoangg9271 8 месяцев назад

    Awesome! I was able to install Hadoop on Ubuntu successfully. I'm from Vietnam with love. Thank you very much

  • @EMunkhjin
    @EMunkhjin 10 месяцев назад +1

    how to create hadoop_install_config.txt file. I have no this file in my downloads

    • @IvyProSchool
      @IvyProSchool  10 месяцев назад

      you can find that file in video description.

  • @vignatej663
    @vignatej663 10 месяцев назад

    thanks bro

  • @Sravan508
    @Sravan508 5 месяцев назад +2

    kindly also explain how to run a simple mapreduce job on it?

    • @IvyProSchool
      @IvyProSchool  4 месяца назад

      This is a map reduce code of calculating pi value "hadoop jar /home/rakib/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.4.jar pi 10 100". You can watch Hive installation video for more use cases of Map Reduce.

  • @Matt-jj5po
    @Matt-jj5po 5 месяцев назад +1

    is it possible to install hadoop on different disk? I tried to do the same on path: /media/ubuntu/D/hadoop/etc/hadoop and it didn't work

    • @IvyProSchool
      @IvyProSchool  4 месяца назад +1

      Yes, it's possible. You have to give the access permission of that path using chmod

  • @PrinceKumar-zs5uf
    @PrinceKumar-zs5uf 4 месяца назад

    thanks a lot

  • @mihirchavan6292
    @mihirchavan6292 6 месяцев назад +1

    Inside hadoop lib folder is not present

    • @IvyProSchool
      @IvyProSchool  4 месяца назад

      Go inside Hadoop folder using cd command then press ls. You can see lib folder is present.

  • @Thriver21
    @Thriver21 2 месяца назад

    🙏👏

  • @zahraaadel2690
    @zahraaadel2690 9 месяцев назад

    Why it can not run command hdfs?

    • @IvyProSchool
      @IvyProSchool  9 месяцев назад

      may be some properties need to be added in mapred-site.xml file. So when you run the any hdfs command it'll show error and show some properties needed to be updated, copy those properties into mapred-site.xml file with hadoop_home path.

  • @shadowkeenan6192
    @shadowkeenan6192 9 месяцев назад +1

    Why the name node is not showing.

    • @IvyProSchool
      @IvyProSchool  9 месяцев назад +1

      check web UI after starting the nodes using this link localhost:9870/

  • @abhisheksubhash9382
    @abhisheksubhash9382 6 месяцев назад

    My datanode is not showing. When I ran jps command

    • @IvyProSchool
      @IvyProSchool  6 месяцев назад

      delete namenode and datanode folders under /home/user/hadoop/data using rm -r command, again create those folders in that location after that format the namenode finally start the hadoop cluster

  • @swohardokhanpranto3576
    @swohardokhanpranto3576 3 месяца назад

    Localhost: permission denied (publickey,password). how can i fix this?

  • @user-kj8tf6fx6n
    @user-kj8tf6fx6n 6 месяцев назад

    My Datanode is not showing when I ran jps command

    • @IvyProSchool
      @IvyProSchool  6 месяцев назад

      delete namenode and datanode folders under /home/user/hadoop/data using rm -r command, again create those folders in that location after that format the namenode, finally start the hadoop cluster

    • @shresthabinesh1996
      @shresthabinesh1996 6 месяцев назад

      Sir can you make video on it

    • @prateek_25
      @prateek_25 6 месяцев назад

      its not working
      @@IvyProSchool

  • @immonabeer902
    @immonabeer902 3 месяца назад

    how to add root