Hi Madam, please tell me the what are the versions(stable) of spark with scala and pyspark versions currently using in the industry as per your knowledge
Hi Bharath, For Spark 2.x you can go with Scala 2.11 or 2.12. For Spark 3.x you can go with csala 2.12. And for Pyspark, you can choose Spark 2.4x, Python 3.7 to 3.9. For Spark 3.x, choose Python 3.9
![[hindi]Spark Zero to Hero- Lesson 3 Use of CataLyst Optimizer with Example](/img/1.gif)
Nice explanation Sravana, I have one doubt, is this tool designed for Developers or Testers?
Thanks a lot Sravan.
This is used in the development phase to test the functional / technical scenarios. Testers can refer to these for their testing.
Hi Madam,
please tell me the what are the versions(stable) of spark with scala and pyspark versions currently using in the industry as per your knowledge
Hi Bharath, For Spark 2.x you can go with Scala 2.11 or 2.12. For Spark 3.x you can go with csala 2.12. And for Pyspark, you can choose Spark 2.4x, Python 3.7 to 3.9. For Spark 3.x, choose Python 3.9
@@sravanalakshmipisupati6533 can you please make a video on difference between spark2.0 and spark3.0