24. Create Temp view in PySpark | createOrReplaceTempView() function in PySpark

Поделиться
HTML-код
  • Опубликовано: 17 окт 2024
  • #spark #pyspark #dataengineering #dataengineer #learnpyspark
    In this video, I discussed about createOrReplaceTempView() function which helps to create temporary tables with in the session, so that we can access them using SQL.
    Want more similar videos- hit like, comment, share and subscribe
    ❤️Do Like, Share and Comment ❤️
    ❤️ Like Aim 5000 likes! ❤️
    ➖➖➖➖➖➖➖➖➖➖➖➖➖
    Please like & share the video.
    ➖➖➖➖➖➖➖➖➖➖➖➖➖
    dataset
    data=[(1,'manish',10000),(2,'rani',50000),(3,'sunny',5000)]
    columns=['id','name','salary']
    ➖➖➖➖➖➖➖➖➖➖➖➖➖
    AWS DATA ENGINEER : • AWS DATA ENGINEER
    Azure data factory :
    • Azure Data Factory
    Azure data engineer playlist : • Azure Data Engineer
    SQL PLAYLIST : • SQL playlist
    PYSPARK PLAYLIST -
    • Pyspark Tutorial
    ➖➖➖➖➖➖➖➖➖➖➖➖➖
    📣Want to connect with me? Check out these links:📣
    Join telegram to discuss t.me/+Cb98j1_f...
    ➖➖➖➖➖➖➖➖➖➖➖➖➖
    what we have covered in this video:
    createOrReplaceTempView() method
    You can also use the createOrReplaceTempView() method on a DataFrame to create a temporary view from it
    ➖➖➖➖➖➖➖➖➖➖➖➖➖
    Hope you liked this video and learned something new :)
    See you in next video, until then Bye-Bye!
    ➖➖➖➖➖➖➖➖➖➖➖➖➖

Комментарии • 7

  • @mdabdulaziz5476
    @mdabdulaziz5476 Месяц назад +1

    Well explained

  • @bhargavmuppidi4906
    @bhargavmuppidi4906 3 месяца назад +1

    This helps df to convert to spark table very useful 🙂

  • @kalakritibysanskriti
    @kalakritibysanskriti 3 месяца назад +1

    Thanks

  • @maheswarpalagiri566
    @maheswarpalagiri566 3 месяца назад

    Hi sir is your playlist for pyspark enough to completely learn pyspark ?

    • @learnbydoingit
      @learnbydoingit  3 месяца назад +1

      Yes we are adding more , as well project

  • @prabhatrai8873
    @prabhatrai8873 Месяц назад

    Hi Bro, I want a problem solution. Can you help me out on this?
    See, I have created a table with 4 columns and then I added one more column "salary" based on another column. But when I apply group by on derived column, it's getting error.
    show like - salary col can not be resolved.
    I just want to know if we create a col from an existing col in dataframe so if we want to use this derived col("salary") further for any operation. How can we do that?
    Hope you are getting what I am trying to say

    • @learnbydoingit
      @learnbydoingit  Месяц назад

      U mean derive column u are not able to call ? Have u stored this in new df ?
      Is salary column available in new df?