RDD Size Programmatically | Hands-on Code | Interview Question

Поделиться
HTML-код
  • Опубликовано: 7 сен 2024

Комментарии • 1

  • @raksadi8465
    @raksadi8465 4 года назад

    Getting error while calculating size in 3rd approach using logical plan in spark-shell
    :27: error: lazy value sessionState in class SparkSession cannot be accessed in org.apache.spark.sql.SparkSession
    val size=spark.sessionState.executePlan(ctplan).optimizedPlan.stats.sizeInBytes