Spark Tutorial in Microsoft Fabric (3.5 HOURS!)

Поделиться
HTML-код
  • Опубликовано: 21 дек 2024

Комментарии • 47

  • @LearnMicrosoftFabric
    @LearnMicrosoftFabric  11 месяцев назад +6

    Hi all, I've launched a free Fabric learning community, join and ask me anything in there! www.skool.com/microsoft-fabric

  • @rasmusandreasson1548
    @rasmusandreasson1548 Год назад +8

    Just started using Fabrics, you are a savier, please do not stop doing this kind of content! Great Work!

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  Год назад

      Welcome to the party - great to have you on board :) taking a short break at the moment but will be back very soon!!

  • @christopherpfeifer9772
    @christopherpfeifer9772 9 месяцев назад +2

    Completed thru day 7, everything works well. At my age (62) I have given up trying to memorize coding syntax, downloading your "learning" notebooks allows me to build a library of coding syntax. This allow me to spend my time learning "what" I need to do, then using the library examples to figure out the "how."

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  9 месяцев назад +1

      Great job Christopher, that's a wise strategy! Syntax you can always look up, but learning how to problem solve is the most important thing 👍

  • @AdrianMcGavock
    @AdrianMcGavock 9 месяцев назад +1

    what a FANTASTIC vid... really enjoying your series, please keep them coming as you're putting out much higher quality content than anyone else ⭐

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  9 месяцев назад +1

      Glad you enjoyed! Thanks for your kind comments, lots of other great people creating content too though 🙌🏽

    • @AdrianMcGavock
      @AdrianMcGavock 9 месяцев назад

      @@LearnMicrosoftFabric good to hear, can only comment from what I've experienced... who else do you recommend for jargon-free enlightenment 🤔?

  • @ostrich97
    @ostrich97 11 месяцев назад +1

    Just wanted to let you know you are doing a great job. Hopefully you will get recognized properly.

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  11 месяцев назад +1

      Hey thanks for watching and thanks a lot for your very kind words, I truly appreciate it.

  • @tea0819
    @tea0819 11 месяцев назад +1

    Great Job on this Series! Enjoyed watching it! Keep up the great work!!!

  • @Karenshow
    @Karenshow Год назад +1

    I absolutely love your videos. Please keep making them.

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  Год назад +1

      thanks for watching and for your lovely comment! don’t worry, if people still watch them and find them useful, I’ll keep making them!

  • @aslakjonhaugen3004
    @aslakjonhaugen3004 Год назад +1

    Fantastic video! 🤩 Please continue with this amazing work! 👌

  • @PatrickBateman12420
    @PatrickBateman12420 9 месяцев назад +1

    You stopped your consulting job to focus 100% on teaching Fabric?
    Wow, you're convinced about Fabric. Glad to hear!

  • @LearnMicrosoftFabric
    @LearnMicrosoftFabric  Год назад +1

    Please like and share with friends/ colleagues if you find this 3.5 hour tutorial useful!
    Also, I have uploaded all Fabric Notebooks to my GItHub (link in description above), to get the full learning experience, I recommend you:
    1. Download the Notebooks and sample datasets.
    2. To import a notebook into your Fabric Workspace, go to Workspace homepage, click on New > Import Notebook (at bottom of list).
    3. Run the code in your notebook as you watch the specific tutorial, and explore extensions to the notebook, using the documentation (also linked in the GitHub readme file).
    Enjoy!!! 😀

  • @aslakjonhaugen3004
    @aslakjonhaugen3004 Год назад +2

    Yes please! :-) Please make a deep dive into machine learning and use of AI in Fabric-video! :-)

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  Год назад +2

      Fabric is the platform for the era of AI, so I’ll definitely be doing lots of AI/ML stuff soon!

  • @lanac9348
    @lanac9348 Год назад

    This is really interesting! glad I found your channel 😊Keep making more or them, your videos are easy to understand, not very basic but not difficult just in the perfect spot 😊 Your videos helped me with my MS Fabric learning journey and more 😊 next time show us how to pass the Fabric exam certifications 😊

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  Год назад

      Hey Lana, thanks for watching, and I'm glad you're finding it interesting! Definitely a lot more videos in the pipeline, just going through a busy period with work. And yes the Fabric exam certifications is definitely something I'll be covering in the future.

  • @shafa7668
    @shafa7668 Год назад

    Really nice vedio mate. I have not watched the whole of it yet, but will do soon at one go.

  • @timmole-w5r
    @timmole-w5r 4 месяца назад

    Awesome tutorial - thanks!

  • @otmaneababou4176
    @otmaneababou4176 10 месяцев назад

    Thank u will needahm, awesome content. Could u tell me where are now the learning materials for your tutorial? didn't find them on github

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  10 месяцев назад

      Hey thanks for watching! The materials/ notebooks should all still be available here... let me know if you cannot see them! github.com/LearnMicrosoftFabric/RUclips/tree/main/learn_spark_in_fabric

  • @peternguynguyen5208
    @peternguynguyen5208 11 месяцев назад

    Love these videos, thank you

  • @matheusmartinsmoreno
    @matheusmartinsmoreno Год назад

    Amazing. Thank you so much for this.

  • @noahhadro8213
    @noahhadro8213 11 месяцев назад

    when I do df.printSchema() and I get an error statinng "'DataFrame' object has no attribute 'printSchema'". Can you help with this?

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  11 месяцев назад

      Hey check type(df). I would guess that your df object is not of type spark dataframe. Is it a pandas dataframe?

    • @noahhadro8213
      @noahhadro8213 11 месяцев назад

      yes you are correct. It looks to be a "pandas.core.frame.DataFrame"@@LearnMicrosoftFabric

  • @giorgikalandadze6172
    @giorgikalandadze6172 9 месяцев назад

    So I need to learn Python before I start with Spark? or I could go easily with SQL?

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  9 месяцев назад +1

      Hey, thanks for the question! It is possible to run SQL queries against spark dataframes (see spark.apache.org/docs/latest/sql-getting-started.html#running-sql-queries-programmatically)... but I think it's worthwhile learning Python too as it opens up a lot more options/ functionality

    • @giorgikalandadze6172
      @giorgikalandadze6172 9 месяцев назад

      @@LearnMicrosoftFabric Thanks!

  • @BharathKumar-ch4tp
    @BharathKumar-ch4tp 11 месяцев назад

    can we create and execute the stored procedure in notebook?

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  11 месяцев назад

      Hey that's an interesting question. I think out-the-box there is no functionality for this currently. There _might_ be a way to do this through the TDS endpoint, but I haven't needed to do this myself yet (learn.microsoft.com/en-us/fabric/data-warehouse/connectivity)

    • @BharathKumar-ch4tp
      @BharathKumar-ch4tp 11 месяцев назад

      @@LearnMicrosoftFabric Thank you for the reply, And I have few other queries as well, where can I ask you about the same

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  11 месяцев назад

      @@BharathKumar-ch4tp Hey feel free to ask on the Skool community: skool.com/microsoft-fabric

  • @ankittripathi8305
    @ankittripathi8305 2 месяца назад

    Great video

  • @OnkelMM
    @OnkelMM 3 месяца назад

    Good stuff

  • @DaleWells-w5j
    @DaleWells-w5j Месяц назад

    I am a new member, and I have spent less than 30 days working with Fabric Environment, I am into my third project. Yesterday I started re-listening to all 30 of your Fabric videos and completed them today. I was particularly looking for an answer on how to properly code this script to extract a table and write it to an external CSV file.
    AttributeError Traceback (most recent call last)
    Cell In[17], line 177
    173 spark = SparkSession.builder.getOrCreate()
    175 df=spark.sql("""select * from SrvySmryWithContract""")\
    176 .show(n=10)
    --> 177 df.coalesce(1).write.format("csv")\
    178 .options(header='True', delimiter=',')\
    179 .mode('overwrite')\
    180 .save(path='Users/DWELLS/Downloads/SrvySmryWithContract.csv')
    AttributeError: 'NoneType' object has no attribute 'coalesce'