Latest Hadoop 3.2.2 Spark 3.1.2 installation in windows | Spark Training In Hyderabad

Поделиться
HTML-код
  • Опубликовано: 17 окт 2024
  • In this video explaining how to install Hadoop, spark, Java 11 in windows explained in this video. Simple way. Nowadays Hadoop 3.2.2 and spark 3.1.2 are only highly stable. I recommend install these versions only. Sometimes you will get compatible issues if u use different Hadoop & spark versions.
    for more tips subscribe
    t.me/SparkTrai...
    Its recommended: Java 11 spark 3.1.2 , hadoop 3.2.2, and python 3.8 (if pyspark)
    or
    Java 1.8.202, Spark 2.4.8 and hadoop 2.7.2 and python 3.6 (if pyspark)
    recommended .. don't use python 2.7
    for more tips follow : t.me/SparkTrai...
    If you are looking for apache spark training please contact www.apachespar... or call +91-8500002025
    www.anaconda.c...
    archive.apache...
    archive.apache...
    www.oracle.com...
    Now click on Windows x64 Installer .. you ll get popup enter these credentials.
    Credentials: venumssi@gmail.com / Opassword.1
    github.com/ait...
    www.jetbrains.... (download community version)
    drive.google.c...
    This software also highly recommended
    downloads.ligh...
    www.jetbrains.... (download community version)
    winscp.net/dow...
    github.com/sbt...
    Pls download these datasets
    github.com/ait...
    the.earth.li/~...
    git-scm.com/do...
    .....
    More spark/bigdata tips Please visit:
    www.apachespark...
    / sreyobhilashiit
    / bigdataanalyst

Комментарии • 40

  • @jitendrashimpi9964
    @jitendrashimpi9964 Год назад +1

    hey, Venu sir Thank you so much for making the Spark and Hadoop downloads easily accessible. I hope you continue to share your expertise and helpful downloads. You're making a real difference🤩

  • @sonip472
    @sonip472 2 года назад +2

    Thanks a ton, finally i am able to install spark and hadoop on my laptop, you are a life savior....thanks a lot sir.🙏

  • @reddymaestro3569
    @reddymaestro3569 2 года назад

    what a way that you are explaining..simpy superb...i tried alot with maven which did not went well...take a bow

  • @KaranSingh-hx8dh
    @KaranSingh-hx8dh 2 года назад

    Thankyou for contacting sir, I got the link and sharing me link. I got hadoop installed.

  • @SanivarapuGangaPriya
    @SanivarapuGangaPriya 7 месяцев назад

    Venu sir, In your provided dependencies there is no configuration in mapred-site.xml and yarn-site.xml .can you provide it clearly so that start-yarn will run

  • @varundcs
    @varundcs 2 года назад +1

    very clear instructions and was able to start both the hadoop3.2.1 and spark 3.1.2. Thanks much!!

    • @stream2learn
      @stream2learn 2 года назад

      ruclips.net/video/3LTSSzBZvXE/видео.html

    • @stream2learn
      @stream2learn 2 года назад

      Check my Spark tutorial.
      ruclips.net/video/3LTSSzBZvXE/видео.html

  • @santoshkumarthammineni3897
    @santoshkumarthammineni3897 2 года назад

    Excellent Explanation...in simple words.

  • @shubhambhosale8467
    @shubhambhosale8467 Год назад

    start-yarn is not working its not showing nodemanager and resourcemanager

  • @m.azharali8192
    @m.azharali8192 2 года назад

    For the installation of spark I got "the system cannot find thevpath specified" .I installed spark2.3.0 .How to rectify this ?

  • @shortalgaming2824
    @shortalgaming2824 2 года назад

    thank u so much sir really helpfull.

  • @soulcra2084
    @soulcra2084 2 года назад

    This video saved me. Thanks alot.

  • @aravindhanr721
    @aravindhanr721 Год назад

    I am getting error while typing hdfs name node format the error show java home is incorrectly set but i set as per video

    • @SreyobhilashiIT
      @SreyobhilashiIT  Год назад

      in this video 4:47 pls follow carefully Java home must be same path don't mention c://Program files/Java/java-11 path .. the main reason if u have space u ll get error.
      so mention path without space

  • @deepakkumar-yl6nc
    @deepakkumar-yl6nc 2 года назад +1

    Hi sir, can you please make a video on airflow so that we can understand how we run our jar by airflow dag

  • @Rohitt.96
    @Rohitt.96 Год назад +1

    Sir can you teach me about spark and aws?

  • @guto5539
    @guto5539 2 года назад +1

    Thank you so much!

  • @mayurkale1570
    @mayurkale1570 2 года назад

    On Spark shell giving me error as NullPointerException

  • @MrTechGuy9999
    @MrTechGuy9999 Год назад

    i tried the same way but spark-shell is not working

    • @SreyobhilashiIT
      @SreyobhilashiIT  Год назад

      simple, close terminal and open again .. now try working fine

  • @siddhi_jain0801
    @siddhi_jain0801 2 года назад

    Hi, Thanks your explanation nd steps are very clear.
    I followed all the steps but still its not installed not even reflecting on cmd.
    Can you please help on that.

    • @SreyobhilashiIT
      @SreyobhilashiIT  2 года назад

      whatsapp me ur error wa.me/918500002025

    • @vivekchandak2759
      @vivekchandak2759 2 года назад +1

      solve huha kya same

    • @stream2learn
      @stream2learn 2 года назад

      Check my Spark tutorial.
      ruclips.net/video/3LTSSzBZvXE/видео.html

  • @gauravgupta4983
    @gauravgupta4983 2 года назад

    Where is file save in hdfs, path of drive where datasets folder present

  • @girmaabinte9290
    @girmaabinte9290 2 года назад

    very good

  • @KaranSingh-hx8dh
    @KaranSingh-hx8dh 2 года назад

    Sir will you please share hadoop dependencies download link.

    • @VenuKatragadda
      @VenuKatragadda 2 года назад +1

      github.com/aitraining/datasets/blob/main/hadoop-dependencies-3.2.2.zip already shared in this RUclips description

    • @omniaosman8247
      @omniaosman8247 Год назад

      Please share hadoop dependencies download link

  • @MrMadmaggot
    @MrMadmaggot 2 года назад

    Man what about the Winutils?

    • @SreyobhilashiIT
      @SreyobhilashiIT  2 года назад

      in this video description i mention hadoop dependencies use that

    • @MrMadmaggot
      @MrMadmaggot 2 года назад

      @@SreyobhilashiIT Got errors while extracting headoop 3.2.2
      Files couldn't be created

  • @ajsingh3556
    @ajsingh3556 2 года назад

    thank you sir, but still spark shell not found

  • @nilamsahu9603
    @nilamsahu9603 2 года назад

    hadoop installation showing error