SPARK SCALA Installation in WINDOWS | Enjoy learning | Tamilboomi
HTML-код
- Опубликовано: 15 сен 2024
- Tamilboomi Spark Tutorial:
Installing Spark Scala in windows machine:
Pre Requirments to install Spark: Java 8 & Scala
Step 1:
Install java 8:
java.com/en/do...
Step 2 :
Download Install Scala :
www.scala-lang....
Step 3:
Install spark:
spark.apache.or...
Configuration:
What makes the huge difference between the operating systems is Hadoop that is used internally for file system access in Spark.
You may run into few minor issues when you are on Windows due to the way Hadoop works with Windows' POSIX-incompatible NTFS filesystem.
Solution : wiki.apache.or...
we know of at least one usage, it is for running shell commands on Windows OS
github.com/ste...
Hive issue:
E:/Professional/hadoop/bin/winutils.exe chmod 777 E:/tmp/hive/
Verification and running first program:
spark.range(1).withColumn("status", lit("All seems fine. Congratulations!")).show(false)
val hellomakkale = sc.textFile("E:\\hellomakkale.txt")
hellomakkale.collect()
For More :
Whatsapp : +91 9619663272
Facebook : tamilboomiofficial
aruthecoach
email : arumugamsip@gmail.com
Twitter : aruthecoach
~-~~-~~~-~~-~
Please watch: "How Consultancies & Training Institutes cheats US? | Are you a FRESHER SEARCHING FOR A JOB?"
• How Consultancies & Tr...
~-~~-~~~-~~-~
super sir, Nalla explanation. I installed spark in windows. I was eagerly waiting for such simple explanation. Keep doing more such videos. I never knew we can install spark in windows , felt very happy after installation.
please tell me how to configure the spark in eclipse......... and explain what is SBT and maven..........
can yu provide tutorial on spark sql
Hat nalla irukku
bro i have windows 7 ,i am trying to install scala some errors are occurred,,,. "could not retrieve jansi 1.11"what I do bro???
stackoverflow.com/questions/40046325/not-able-to-install-sbt-in-windows-7
Ram requirement
Ram min 4 gb will be sufficient for practice usage. Will require more if you go for more processing.