Studytronix
Studytronix
  • Видео 79
  • Просмотров 133 574
How to Install Spark | Pyspark | Python | Pycharm IDE on Local Machine
How to Install Spark | Pyspark | Python | Pycharm IDE on Local Machine
The installation process is available in the file on the below link
github.com/akshay18JTDJ/spark_documentation/raw/main/Spark%20Documentation.pdf
#pyspark #pycharm #spark #installation #local #machine
Просмотров: 14 837

Видео

16 BIT ADDITION IN 8051
Просмотров 4,7 тыс.Год назад
16 BIT ADDITION IN 8051 Add two 16-bit numbers stored in the internal RAM memory locations of 8051. #8051 , #16bit , #addition , #Keil , #program , #assembly , #code
Data Block Transfer (Copy) in 8051
Просмотров 525Год назад
Data transfer from one memory location in RAM to another memory location in RAM. #Block Transfer, #8051
Timer 1 in PIC 16F877
Просмотров 4,1 тыс.2 года назад
Internal construction of timer 1 in PIC16F877. #pic16f877a #timer #block #diagram
Timer 0 in PIC 16F877
Просмотров 4,7 тыс.2 года назад
Timer 0 in PIC 16F877
RemoteXY Tutorial for Mobile app for IoT Application
Просмотров 11 тыс.2 года назад
RemoteXY Tutorial for Mobile app for IoT Application
PWM waveform generation using PIC 16F877 (Detailed explanation of code and theory)
Просмотров 4,9 тыс.3 года назад
PWM waveform generation using PIC 16F877 (Detailed explanation of code and theory)
MATLAB Basics
Просмотров 2703 года назад
MATLAB Basics
How to install MATLAB 30-days Trial Software
Просмотров 9 тыс.3 года назад
How to install MATLAB 30-days Trial Software
How to use Toggle Button in MATLAB GUI
Просмотров 5973 года назад
How to use Toggle Button in MATLAB GUI
How to use Popup Menu in MATLAB GUI
Просмотров 1,2 тыс.3 года назад
How to use Popup Menu in MATLAB GUI
How to use Checkbox in MATLAB GUI
Просмотров 1,1 тыс.3 года назад
How to use Checkbox in MATLAB GUI
How to use Radio Button MATLAB GUI
Просмотров 1,4 тыс.3 года назад
How to use Radio Button MATLAB GUI
How to use slider in MATLAB GUI
Просмотров 4,7 тыс.3 года назад
How to use slider in MATLAB GUI
How to use Axes in MATLAB GUI
Просмотров 1,9 тыс.3 года назад
How to use Axes in MATLAB GUI
How to use Push button in MATLAB GUI
Просмотров 8033 года назад
How to use Push button in MATLAB GUI
IoT Application Development using NodeMCU and RemoteXY
Просмотров 2113 года назад
IoT Application Development using NodeMCU and RemoteXY
Procedure to add Arduino library to Proteus
Просмотров 614 года назад
Procedure to add Arduino library to Proteus
Lecture 20 Timer Modes
Просмотров 624 года назад
Lecture 20 Timer Modes
Lecture 19 Timer SFRs
Просмотров 754 года назад
Lecture 19 Timer SFRs
Lecture 18 Timers
Просмотров 504 года назад
Lecture 18 Timers
Lecture 15 Interrupts
Просмотров 6704 года назад
Lecture 15 Interrupts
Lecture 12 Rotate Instructions
Просмотров 2664 года назад
Lecture 12 Rotate Instructions
Lecture 13 Addressing Modes
Просмотров 2,2 тыс.4 года назад
Lecture 13 Addressing Modes
Lecture 14 IO Ports
Просмотров 4874 года назад
Lecture 14 IO Ports
Lecture 17 Interrupt SFRs
Просмотров 584 года назад
Lecture 17 Interrupt SFRs
Lecture 16 Interrupts in 8051
Просмотров 454 года назад
Lecture 16 Interrupts in 8051
Lecture 15 IO Ports in 8051
Просмотров 4064 года назад
Lecture 15 IO Ports in 8051
Lecture 14 Branching Instructions Part 3
Просмотров 324 года назад
Lecture 14 Branching Instructions Part 3
Lecture 13 Branching Instructions Part 2
Просмотров 304 года назад
Lecture 13 Branching Instructions Part 2

Комментарии

  • @qwertyjlkd1-1
    @qwertyjlkd1-1 5 дней назад

    thank you, but i have issue: output was "Cannot run program "python3": CreateProcess error=2, The system cannot find the file specified", can you solve, what i should to do?

    • @AkshayBhosale18
      @AkshayBhosale18 4 дня назад

      @@qwertyjlkd1-1 you need to check whether environment variables are configured properly or not.

  • @ChandanDeveloper
    @ChandanDeveloper 18 дней назад

    thanks @Studytronix I was stuck at installation point. when we hitting spark-shell command then not giving such installation information

  • @touhid92
    @touhid92 Месяц назад

    [init] error: bad constant pool index: 0 at pos: 49176 while compiling: <no file> during phase: globalPhase=<no phase>, enteringPhase=<some phase> library version: version 2.12.17 compiler version: version 2.12.17 reconstructed args: -classpath -Yrepl-class-based -Yrepl-outdir C:\Users\DELL\AppData\Local\Temp\spark-d2e2155b-4f5c-4a6d-9403-31263ac3a92e epl-7f26def7-ec1a-43b7-9fad-d46744aa8581 last tree to typer: EmptyTree tree position: <unknown> tree tpe: <notype> symbol: null call site: <none> in <none> == Source file context for tree position == Exception in thread "main" scala.reflect.internal.FatalError: bad constant pool index: 0 at pos: 49176 while compiling: <no file> during phase: globalPhase=<no phase>, enteringPhase=<some phase> library version: version 2.12.17 compiler version: version 2.12.17 reconstructed args: -classpath -Yrepl-class-based -Yrepl-outdir C:\Users\DELL\AppData\Local\Temp\spark-d2e2155b-4f5c-4a6d-9403-31263ac3a92e epl-7f26def7-ec1a-43b7-9fad-d46744aa8581 I am getting above error. Please anyone help me

  • @anishawali
    @anishawali Месяц назад

    Thank you, you helped me

  • @anandh1967
    @anandh1967 Месяц назад

    What if carry is present in lower bit addition

  • @vishnuchopra1127
    @vishnuchopra1127 Месяц назад

    Bro app legend ho.... Seriously kese thank you karu aapka. Mai pagal ho gya the pyspak installation k chakkar me. Finally successfully kar liya aapki video dekh kar. God bless ya bro

  • @iAmDecemberBorn
    @iAmDecemberBorn 2 месяца назад

    bhai tum legend ho !!! maine bahut sare tutorial dekhe, sab bahenchod bas kisi firangi ka vdo dekh kar bana diye (copy pastse) and getting errors. you explain very well. i owe you mug of beeer !! thanks alot baawa

    • @AkshayBhosale18
      @AkshayBhosale18 2 месяца назад

      @@iAmDecemberBorn Thanks for the appreciation ☺️

  • @karthika1920
    @karthika1920 3 месяца назад

    😊👍

  • @sifaelectron
    @sifaelectron 3 месяца назад

    You can't give a shorter explanation

  • @harshshukla7122
    @harshshukla7122 3 месяца назад

    Thanks a lot bro, Crisp and clear..!!

  • @edwindsouza3359
    @edwindsouza3359 4 месяца назад

    Thanks, This helped

  • @electrowashyelect9715
    @electrowashyelect9715 4 месяца назад

    In an LCD display project if the LCd showing corrupted character. Which the circuit needs to be restart at that instances either buy power restart or memory clear reset. Can WDT , monitor the operation and on let this reset the wdt when the operation is low

    • @AkshayBhosale18
      @AkshayBhosale18 4 месяца назад

      WDT can be used only to monitor proper working of CPU. It cannot be used for monitoring external peripherals.

    • @electrowashyelect9715
      @electrowashyelect9715 4 месяца назад

      Can u explains how that can be achieved

  • @ayushgupta-zl6qh
    @ayushgupta-zl6qh 4 месяца назад

    Thak you bro ! Clear and accurate , finally spark is running my IDE

  • @tarakeswaritalla1593
    @tarakeswaritalla1593 4 месяца назад

    when i try to run this code then i get error for dataframe getter output but for rdd getting error from pyspark.sql import SparkSession spark = SparkSession.builder \ .appName("PySparkExample") \ .getOrCreate() data = [("Alice", 34), ("Bob", 45), ("Charlie", 30), ("David", 25)] rdd = spark.sparkContext.parallelize(data) df = spark.createDataFrame(rdd, ["Name", "Age"]) df.show() # Show DataFrame contents df.printSchema()

  • @tarakeswaritalla1593
    @tarakeswaritalla1593 4 месяца назад

    what is pythonpath here

  • @dinakaranramanthan2266
    @dinakaranramanthan2266 4 месяца назад

    Unable write bro showing aborting job error

    • @AkshayBhosale18
      @AkshayBhosale18 4 месяца назад

      Try restarting your computer and make sure adequate amount of RAM is available while executing the code

    • @dinakaranramanthan2266
      @dinakaranramanthan2266 4 месяца назад

      Bro python worker unexpectedly crashed showing because applying UDF Kindly give solution

  • @odaialtmrawe6285
    @odaialtmrawe6285 4 месяца назад

    I need the code plz

    • @AkshayBhosale18
      @AkshayBhosale18 4 месяца назад

      You can access the code using the following link github.com/akshay18JTDJ/PIC-ADC

    • @odaialtmrawe6285
      @odaialtmrawe6285 4 месяца назад

      @@AkshayBhosale18 thank you I appreciate it❤❤❤❤❤❤❤❤

  • @rpilli
    @rpilli 5 месяцев назад

    could we do the same in vs code ?

    • @AkshayBhosale18
      @AkshayBhosale18 5 месяцев назад

      I have not tried it, but it may work in VS code as well.

  • @ridhakhadhri4491
    @ridhakhadhri4491 5 месяцев назад

    how to fix error: "board not connected to the cloud server "

    • @AkshayBhosale18
      @AkshayBhosale18 5 месяцев назад

      Just make sure the board is connected to wifi hotspot. Crosscheck the username and password of wifi mentioned in the code, both are case sensitive.

  • @anemptyemptiness
    @anemptyemptiness 6 месяцев назад

    thank you!!!!

  • @kunchamvenkatasubbareddy8753
    @kunchamvenkatasubbareddy8753 6 месяцев назад

    When trying to connect to S3 bucket from pycharm. getting error as py4j.protocol.Py4JJavaError: An error occurred while calling o91.load. : org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "s3"...Can you please help me on this

  • @aryanaggarwal5522
    @aryanaggarwal5522 7 месяцев назад

    spark-submit' is not recognized as an internal or external command, operable program or batch file. error is coming

    • @AkshayBhosale18
      @AkshayBhosale18 7 месяцев назад

      Try restarting your laptop. Make sure the paths of all environmental variables are correctly configured.

    • @TrendingShivam789
      @TrendingShivam789 10 дней назад

      @@AkshayBhosale18 Thanks bhai this worked

  • @ranvijaymehta
    @ranvijaymehta 7 месяцев назад

    Thank you so much sir .. its really very very helpful

    • @AkshayBhosale18
      @AkshayBhosale18 7 месяцев назад

      Thank you very much for appreciation

  • @doniyordjon_pro
    @doniyordjon_pro 7 месяцев назад

    When next video?

    • @AkshayBhosale18
      @AkshayBhosale18 7 месяцев назад

      Actually I am busy for another 3 to 4 months so hopefully after that I will be uploading new videos. 🙂

  • @surajithape438
    @surajithape438 7 месяцев назад

    was stuck for hours....you explained precisely to the point...thanks bhawa

  • @JyotsnaBhujbal-y4y
    @JyotsnaBhujbal-y4y 7 месяцев назад

    after installation i am getting this error: df.show() with ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)/ 1] org.apache.spark.SparkException: Python worker exited unexpectedly (crashed) can you pls help? from pyspark.sql import SparkSession import os import sys os.environ['PYSPARK_PYTHON'] = sys.executable os.environ['PYSPARK_DRIVER_PYTHON'] = sys.executable spark = SparkSession.builder.getOrCreate() data = [('James', '', 'Smith', '1991-04-01', 'M', 3000), ('Michael', 'Rose', '', '2000-05-19', 'M', 4000), ('Robert', '', 'Williams', '1978-09-05', 'M', 4000), ('Maria', 'Anne', 'Jones', '1967-12-01', 'F', 4000), ('Jen', 'Mary', 'Brown', '1980-02-17', 'F', -1) ] columns = ["firstname", "middlename", "lastname", "dob", "gender", "salary"] df = spark.createDataFrame(data=data, schema=columns) df.printSchema() df.show()

    • @AkshayBhosale18
      @AkshayBhosale18 7 месяцев назад

      It seems that the error is not related to installation. May be you can restart your PC and try to run the code again. Also try to run any other simple code.

  • @umairgujjar4576
    @umairgujjar4576 8 месяцев назад

    esp do not connect to wifi what was the solution

    • @AkshayBhosale18
      @AkshayBhosale18 8 месяцев назад

      Check the power supply. Check the Wifi credentials entered in code. Check the frequency range of your Wifi hotspot it should be 2.5 GHz. If still it is not connecting then try to use different wifi hotspot or try with different nodeMCU module.

  • @Velben
    @Velben 8 месяцев назад

    I got a py4j error for getOrCreate()

  • @chelladurais-p8y
    @chelladurais-p8y 8 месяцев назад

    I am getting this error. 'spark-submit' is not recognized as an internal or external command, operable program or batch file.

    • @AkshayBhosale18
      @AkshayBhosale18 8 месяцев назад

      Your environment variables and their paths might not be properly configured. Just re-check. and type the command as 'spark-submit --version' there are 2 hyphens before version.

    • @chelladurais-p8y
      @chelladurais-p8y 8 месяцев назад

      @@AkshayBhosale18 I have checked it in environment variables. But I am getting same error again. Pls help me to resolve this issue

    • @AkshayBhosale18
      @AkshayBhosale18 8 месяцев назад

      @@chelladurais-p8y check the version numbers of all files / executables. Use the exact same versions that I have used in video. Try restarting the computer. If still it doesn't work then you need to delete all the folders and environment variables that you have created and repeat the installation process. Also uninstall python if it is already installed.

    • @aryanaggarwal5522
      @aryanaggarwal5522 7 месяцев назад

      same bro

  • @JONSNOW-j2y
    @JONSNOW-j2y 9 месяцев назад

    Sir can you send the Block diagram of this project

  • @amianifineug1353
    @amianifineug1353 9 месяцев назад

    please I got this error in my code ((Error using axes Invalid axes handle))) thank you lot

    • @AkshayBhosale18
      @AkshayBhosale18 9 месяцев назад

      Just check the tag name that you have given to axes property in GUI, same should be used in your code.

  • @abbasmasri9614
    @abbasmasri9614 9 месяцев назад

    I have problem can you get mee any social media accounts to contact you

  • @NeerajKumar-po6gh
    @NeerajKumar-po6gh 9 месяцев назад

    हिंदी में समझाते तो अधिक अच्छा होता,,,,

    • @AkshayBhosale18
      @AkshayBhosale18 9 месяцев назад

      I will try to do it in future

    • @NeerajKumar-po6gh
      @NeerajKumar-po6gh 9 месяцев назад

      @@AkshayBhosale18 आपका बहुत-बहुत धन्यवाद

  • @beyzanurermis8699
    @beyzanurermis8699 9 месяцев назад

    Thanks, it was very helpful 🙏

  • @anshumankumar4993
    @anshumankumar4993 9 месяцев назад

    I am getting error : pyspark.errors.exceptions.base.PySparkRuntimeError: [JAVA_GATEWAY_EXITED] Java gateway process exited before sending its port number.

    • @MUSALERAMPAVAN
      @MUSALERAMPAVAN 19 дней назад

      u need to add 2 more environmental variables after adding this restart system Variable-> SPARK_LOCAL_HOSTNAME Value->localhost Variable-> PYSPARK_PYTHON Value->C:\Users ampavan\AppData\Local\Programs\Python\Python38\python.exe i have used python 3.8 and java 11

  • @paarlychatgpt
    @paarlychatgpt 9 месяцев назад

    when i use RDD org.apache.spark.SparkException: Python worker failed to connect back.

  • @longhuang6092
    @longhuang6092 11 месяцев назад

    Life saving tutorial man. Saved me hours

  • @fassoumathiasniamy3002
    @fassoumathiasniamy3002 11 месяцев назад

    You simply save my day bro. Many thanks

  • @harushua8212
    @harushua8212 11 месяцев назад

    Hey I'm getting PermissionError: [WinError 5] Access is denied when I run my pycharm project. Any idea on this?

  • @saurabhsingh-iz1pn
    @saurabhsingh-iz1pn 11 месяцев назад

    Thanks a lot brother. Simplest and best. Was unable to figure this since past few hours

  • @ashokreddyavutala8684
    @ashokreddyavutala8684 Год назад

    You were very good with all the details.. your video helped me out of many videos I watched on this topic. thank you!! you really helped.

  • @deepakkumarpandia917
    @deepakkumarpandia917 Год назад

    where you have installed the Spark, i think you just extracted it

    • @AkshayBhosale18
      @AkshayBhosale18 Год назад

      Yes, it is just extracted and its path is given in environment variables

  • @abhijeetnayak9077
    @abhijeetnayak9077 Год назад

    where did you make us install python

    • @AkshayBhosale18
      @AkshayBhosale18 Год назад

      When you install pycharm, python gets installed in the background

  • @purvamahajan5837
    @purvamahajan5837 Год назад

    I am not able to download winstill file what should I do

    • @AkshayBhosale18
      @AkshayBhosale18 Год назад

      github.com/steveloughran/winutils/tree/master/hadoop-3.0.0/bin

  • @gamma9645-i4s
    @gamma9645-i4s Год назад

    thank you

  • @uditanshusharma391
    @uditanshusharma391 Год назад

    Bro i am getting an error in cmd "cm" is not recognized as an internal or external command

    • @AkshayBhosale18
      @AkshayBhosale18 Год назад

      Can you tell while installing which software you are getting this error ?

  • @GabrielRamos0
    @GabrielRamos0 Год назад

    Great tutorial!

  • @siprofe9327
    @siprofe9327 Год назад

    Great tutorial! Please keep uploading more videos on PySpark or ones that combine it with SQL.

    • @AkshayBhosale18
      @AkshayBhosale18 Год назад

      Thank you !!! Sure, I will try to upload more videos.

  • @vinitashanmuganathan4712
    @vinitashanmuganathan4712 Год назад

    great bro, I have seen many videos but only this helped me.

  • @Black-heart-3
    @Black-heart-3 Год назад

    Java and python version?

    • @Black-heart-3
      @Black-heart-3 Год назад

      For Python 3.10 which spark version

    • @AkshayBhosale18
      @AkshayBhosale18 Год назад

      @ajaysarwade1520 I have used Java 20.0.1 and Python version that comes with Pycharm-community-2023 edition

    • @Black-heart-3
      @Black-heart-3 Год назад

      @@AkshayBhosale18 Thank you Sir