38 Cummulative sales - PySpark Interview Question | Running Total sales
HTML-код
- Опубликовано: 17 окт 2024
- #pyspark #interviewquestions #interview #pysparkinterview #dataengineer #aws #databricks #python
Cummulative sales - PySpark Interview Question
Cummulative sales Interview Question using pyspark
Cummulative sales Interview Question using spark sql
Want more similar videos- hit like, comment, share and subscribe
❤️Do Like, Share and Comment ❤️
❤️ Like Aim 5000 likes! ❤️
➖➖➖➖➖➖➖➖➖➖➖➖
Please like & share the video.
dataset
data = [ ['2024-01-01',20000], ['2024-01-02',10000],[ '2024-01-03',150000], ['2024-01-04',100000], ['2024-01-05',210000]]
#define column names
columns = ['date', 'sales']
#create dataframe using data and column names
df = spark.createDataFrame(data, columns)
display(df)
➖➖➖➖➖➖➖➖➖➖➖➖➖
AWS DATA ENGINEER : • AWS DATA ENGINEER
Azure data factory :
• Azure Data Factory
Azure data engineer playlist : • Azure Data Engineer
SQL PLAYLIST : • SQL playlist
PYSPARK PLAYLIST -
• Pyspark Tutorial
➖➖➖➖➖➖➖➖➖➖➖➖➖
📣Want to connect with me? Check out these links:📣
Join telegram to discuss t.me/+Cb98j1_f...
➖➖➖➖➖➖➖➖➖➖➖➖➖
what we have covered in this video:
➖➖➖➖➖➖➖➖➖➖➖➖➖
Hope you liked this video and learned something new :)
See you in next video, until then Bye-Bye!
➖➖➖➖➖➖➖➖➖➖➖➖➖
Thanks 🙏
make one video on when to import sql function sql window function and sql types on which scenario based
Bro please make a video for aws step function bro
Hi manish
Can u make a video on facts and dimensional tables
How we load data(full and incremental loading) based on those tables
Especially SCD Type scenario
By using azure adf
Sure , few SCD video already in the channel
@@learnbydoingit yah I have seen even I purchased ur udemy courses long back..petty straightforward and good
.. but I'm looking for fact & dimensional tables ...how can we find out those in realtime
And after finding how can we decide which one we need to load full and which is delta(incrementally) based on table data
I'm totally getting confused by how to combine those three topics
1.Fact and dimensional
2.Full load and incremental (delta)load
And 3. SCD`s implementation