Pyspark Setup With Jupyter Notebook Integration On Windows | Spark | Anaconda | Python

Pyspark or Spark Setup on Windows and Integration with Airflow are demonstrated in this video. Watch each step and you will get it done in no time.
Java 8 Download (Oracle): www.oracle.com/uk/java/techno...
You may have to create an account and login to Oracle in order to download the JDK.
Hadoop winutils Download: github.com/cdarlint/winutils

[@GorlovOleg]

Thanks for the great, clear tutorial.

[@vaibhavgarje3093]

For all those who are getting error after 24:10 do conda uninstall python and then conda install python=3.11.8. Do Like:)

[@ManavNayak-i3b]

I am still getting and error after updating PYSPARK_PYTHON environment varaibale at 24:10.
Error is "Python worker exited unexpectedly (crashed)"
Can you please help.

[@jaffark7]

i still get the error at minute 19:30 even after setting the Python variable, what can it be?

[@dataenthusiast6721]

Try to check your python path using the the following script. Make sure it's pointing to anaconda3.
import os
python_path = os.path.sys.executable
print(python_path)

[@jaffark7]

@@dataenthusiast6721 works fine now,Thanks!