PySpark Tutorial 3: PySpark RDD Tutorial | PySpark with Python

Поделиться
HTML-код
  • Опубликовано: 4 ноя 2024

Комментарии • 18

  • @172_venkateshtohgaonkar5
    @172_venkateshtohgaonkar5 8 месяцев назад

    problem facing like c
    onnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

    • @StatsWire
      @StatsWire  7 месяцев назад

      This looks like some connection issue.

  • @OutlierHUB
    @OutlierHUB Год назад

    i'm getting error :
    Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe.
    : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 2.0 failed 1 times, most recent failure: Lost task 0.0 in stage 2.0 (TID 5) (DESKTOP-0CVOUAC executor driver): org.apache.spark.SparkException: Python worker failed to connect back.
    please suggest

    • @StatsWire
      @StatsWire  Год назад

      Please check on stackoverflow as there is no straightforward answer.

  • @RAMAKRISHNABEERAVELLI
    @RAMAKRISHNABEERAVELLI Год назад

    Hi Bro im getting "RuntimeError: Java gateway process exited before sending its port number" this type of error
    how could i rectify this

    • @StatsWire
      @StatsWire  Год назад

      One possible reason is JAVA_HOME is not set because java is not installed.

  • @Jaspreetkaur-do6on
    @Jaspreetkaur-do6on 2 года назад

    Nice Tutorial
    I got "RuntimeError: Java gateway process exited before sending its port number" error. How can I resolve it ? please give me any suggestions.

    • @StatsWire
      @StatsWire  2 года назад

      One possible thing is that JAVA_HOME is not set up. Please check your environment variables and see if it already exists or create one

    • @Jaspreetkaur-do6on
      @Jaspreetkaur-do6on 2 года назад

      @@StatsWire Thanks for your suggestion.

    • @StatsWire
      @StatsWire  2 года назад

      @@Jaspreetkaur-do6on You're welcome

  • @mazharalamsiddiqui6904
    @mazharalamsiddiqui6904 3 года назад

    Nice tutorial

  • @sreedharvalluri93
    @sreedharvalluri93 2 года назад

    SparkSession is not found. I got this error how can I resolve it

    • @sreedharvalluri93
      @sreedharvalluri93 2 года назад

      Can any one guide me on this

    • @StatsWire
      @StatsWire  2 года назад

      @@sreedharvalluri93 did you import pyspark first?

    • @manjumanjunath6966
      @manjumanjunath6966 Год назад

      Its good work with any files instead of hardcoded values

  • @mathsjockey7571
    @mathsjockey7571 3 года назад

    👍

    • @StatsWire
      @StatsWire  3 года назад

      After a long time Sir. Thank you.