24. Create Temp view in PySpark | createOrReplaceTempView() function in PySpark
HTML-код
- Опубликовано: 17 окт 2024
- #spark #pyspark #dataengineering #dataengineer #learnpyspark
In this video, I discussed about createOrReplaceTempView() function which helps to create temporary tables with in the session, so that we can access them using SQL.
Want more similar videos- hit like, comment, share and subscribe
❤️Do Like, Share and Comment ❤️
❤️ Like Aim 5000 likes! ❤️
➖➖➖➖➖➖➖➖➖➖➖➖➖
Please like & share the video.
➖➖➖➖➖➖➖➖➖➖➖➖➖
dataset
data=[(1,'manish',10000),(2,'rani',50000),(3,'sunny',5000)]
columns=['id','name','salary']
➖➖➖➖➖➖➖➖➖➖➖➖➖
AWS DATA ENGINEER : • AWS DATA ENGINEER
Azure data factory :
• Azure Data Factory
Azure data engineer playlist : • Azure Data Engineer
SQL PLAYLIST : • SQL playlist
PYSPARK PLAYLIST -
• Pyspark Tutorial
➖➖➖➖➖➖➖➖➖➖➖➖➖
📣Want to connect with me? Check out these links:📣
Join telegram to discuss t.me/+Cb98j1_f...
➖➖➖➖➖➖➖➖➖➖➖➖➖
what we have covered in this video:
createOrReplaceTempView() method
You can also use the createOrReplaceTempView() method on a DataFrame to create a temporary view from it
➖➖➖➖➖➖➖➖➖➖➖➖➖
Hope you liked this video and learned something new :)
See you in next video, until then Bye-Bye!
➖➖➖➖➖➖➖➖➖➖➖➖➖
Well explained
This helps df to convert to spark table very useful 🙂
Thanks
Hi sir is your playlist for pyspark enough to completely learn pyspark ?
Yes we are adding more , as well project
Hi Bro, I want a problem solution. Can you help me out on this?
See, I have created a table with 4 columns and then I added one more column "salary" based on another column. But when I apply group by on derived column, it's getting error.
show like - salary col can not be resolved.
I just want to know if we create a col from an existing col in dataframe so if we want to use this derived col("salary") further for any operation. How can we do that?
Hope you are getting what I am trying to say
U mean derive column u are not able to call ? Have u stored this in new df ?
Is salary column available in new df?