Apache Spark - Install Apache Spark 3.x On Windows 10 |Spark Tutorial

Поделиться
HTML-код
  • Опубликовано: 5 ноя 2023
  • This video on Spark installation will let you learn how to install and setup Apache Spark on Windows. First, you will see how to download the latest release of Spark. Then you will set up a winutils executable file which is required for Spark. You will also see how to setup environment variables as part of this installation .
    Spark Download:spark.apache.org/downloads.html
    Winutils download: github.com/steveloughran/winu...
    🙏🏻SUPPORT THE CHANNEL🙏🏻
    Buy me a coffee: ko-fi.com/bigtechtalk
    Subscribe: bit.ly/2A2h6sJ
    Facebook: / bigtechtalk
    Telegram: t.me/bigtechtalk
    #bigtechtalk
    #Spark
    #Install

Комментарии • 26

  • @SashaRakoto
    @SashaRakoto 3 месяца назад +2

    The most usefull video I have seen. Thanks sir !

  • @caioalmeida6954
    @caioalmeida6954 6 месяцев назад +1

    Thanks! It perfectly every step!

  • @tuzyamage915
    @tuzyamage915 7 месяцев назад +1

    amzaing, steps are work like charm !!

  • @pieroteran8626
    @pieroteran8626 Месяц назад +1

    Very good video is Awesome! Thank you!!

  • @bouakrazamira6009
    @bouakrazamira6009 3 месяца назад +1

    thank uu so mush

  • @thanh6296
    @thanh6296 7 месяцев назад +2

    how to fix
    Error: Could not find or load main class org.apache.spark.launcher.Main

  • @somaia03
    @somaia03 7 дней назад

    I found this error when trying to open pyspark I followed all the video steps is there anything wrong with the command?
    scala> SPARK_HOME/bin/pyspark
    :23: error: not found: value SPARK_HOME
    SPARK_HOME/bin/pyspark
    ^
    :23: error: not found: value pyspark
    SPARK_HOME/bin/pyspark

  • @tragik0s
    @tragik0s 2 месяца назад

    Hello i get this error: The filename, directory name, or volume label syntax is incorrect.

  • @gabrielziviani764
    @gabrielziviani764 5 месяцев назад +2

    how to fix:
    The system cannot find the path specified.

  • @pratikmuradi491
    @pratikmuradi491 5 месяцев назад +2

    Hi!
    I have followed each and every step
    While running the spark-shell in command prompt I am getting an error 'spark-shell' is not recognized as an internal or external command, operable program or batch file'
    Please help me out

    • @bigtechtalk
      @bigtechtalk  5 месяцев назад

      Hi @pratikmuradi491
      This error only comes if you environment variable are not properly set. Request you to check environment variable.

  • @eyes9716
    @eyes9716 5 месяцев назад +1

    help me please, this paragraph
    val df = spark.read.fomat("csv").option("header",true).load("D:\\SampleData\\input\\country.csv")
    :22: error: value fomat is not a member of org.apache.spark.sql.DataFrameReader

    • @bigtechtalk
      @bigtechtalk  5 месяцев назад

      Hi @eyes9716
      It should be format not fomat
      val df = spark.read.format("csv").option("header",true).load("D:\\SampleData\\input\\country.csv")

  • @louisizuchi1626
    @louisizuchi1626 Месяц назад +1

    have done this too many time but still get error each time i try to install pyspark

    • @bigtechtalk
      @bigtechtalk  Месяц назад

      Hi @louisizuchi1626
      what the error ??

  • @srinivassri7902
    @srinivassri7902 3 месяца назад +1

    C:\Users\srinivas reddy>spark-shell
    'spark-shell' is not recognized as an internal or external command,
    operable program or batch file.

    • @bigtechtalk
      @bigtechtalk  3 месяца назад

      Hi @srinivassri7902
      This kind of issue comes when your environment variable is not set properly. Can you have a look to you environment variable.

  • @PriyanshuVerma-kv8lp
    @PriyanshuVerma-kv8lp 8 месяцев назад +1

    why its unsafe to visit

    • @bigtechtalk
      @bigtechtalk  7 месяцев назад

      Hi Priyanshu,
      Which site or link are you talking about ??

    • @PriyanshuVerma-kv8lp
      @PriyanshuVerma-kv8lp 7 месяцев назад +1

      github link on description showing unsafe to visit but now its all good , i have installed from git and its working fine thanku for the tutorial really help me