Это видео недоступно.
Сожалеем об этом.

The Azure Spark Showdown - Databricks VS Synapse Analytics

Поделиться
HTML-код
  • Опубликовано: 12 авг 2024
  • Azure now has two slick, platform-as-a-service spark offerings, but which one should you choose? A separate specialist tools or a one-size-fits-all solution? Join Simon as he compares and contrasts the spark offerings.
    Speaker: Simon Whiteley SQLbits.com/speakers/Simon_Wh...
    SQLbits.com/Sessions/The_Azure...
    Tags: Developing,Cloud,Synapse Analytics,Databricks,R,Python,Spark,Data Lake,Big data analytics,AI and data science

Комментарии • 26

  • @RajeshRRajamani
    @RajeshRRajamani Месяц назад

    I know its a bit late to comment on this given Synapse has evolved and so has Databricks . Nevertheless worth every second . Really comprehensive overview . Thank you for this great work Simon.

  • @Markttt5
    @Markttt5 2 года назад +9

    What a great video - really well put. Any chance of a rematch factoring in where we are now in 2022. Seriously though, when you work in an environment where your management don’t fully understand the technology and get swept away with the latest buzz words, it’s hard to keep their feet on the ground. I now feel more empowered to push back when appropriate. You’re a natural speaker and clearly very passionate about what you do. Cheers.

    • @SQLBits
      @SQLBits  2 года назад

      Hey! As this is from our last event Simon covered all things about 2022 updates at our most recent event (SQLBits), it's an event in the Uk that hosts all the data professionals and shares brand NEW updates and releases.

  • @imsushantjain
    @imsushantjain 2 года назад +1

    Brilliant stuff - the best introduction to Databricks and comparison to Synapse that I have ever seen. Thank you Simon!, looking forward to more videos from this channel.

  • @gravenguan
    @gravenguan 2 года назад +1

    Really great content, hard to find such in depth comparison, respect and keep it up!

  • @alexischicoine2072
    @alexischicoine2072 3 года назад +5

    I don't have access to synapse at work yet but we've had access to databricks for a bit. My current thinking is to keep using databricks for spark, but to use synapse for the pipelines and the sql pools. Synapse also has powerbi integration and the pipelines can run databricks notebooks.
    The other question for me will be to see what works better to serve a Tableau report between synapse sql pools or sql endpoints in databricks.
    For small tables on very specific queries I'm thinking synapse might work well with its indexes. I've tried using zordering and bloom filters in Databricks but these don't seem to help much with relatively small data where each hive partition only has one file of about 100mb.

    • @Niranjan6029
      @Niranjan6029 2 года назад

      Hi @alexis ,can you please help with the azure databricks transformations.please let me know most used azure databricks realtime transformations by you

  • @dans4786
    @dans4786 Год назад

    Your distributed compute explanation is crystal clear thx

  • @carltonpatterson5539
    @carltonpatterson5539 3 года назад +3

    Another fantastic overview. Thank you so much

    • @SQLBits
      @SQLBits  3 года назад

      Glad you enjoyed it!

  • @MezMezMez1
    @MezMezMez1 2 года назад

    Excellent video - so much information packed in and very well presented!

  • @jochenjuelke265
    @jochenjuelke265 3 года назад +2

    excellent overview & comparison, thanks for that insights!

  • @smdemmery
    @smdemmery 2 года назад +1

    Great video, interesting stuff indeed, thanks

  • @jakubdaleki7941
    @jakubdaleki7941 3 года назад +2

    Excellent comparison! I just wonder why in price comparison Synapse Spark Pools went with 2 instances vs 3 Databricks instances? What is more Databricks has job cluster, which are created for the given job and terminated after completing, and these clusters are much much cheaper :) 40:33

  • @osamaasif9601
    @osamaasif9601 Год назад +1

    It's easy to integrate both azure synapse and azure data bricks so instead of using spark pools in synapse you can use data bricks for azure

  • @Krumelur
    @Krumelur Год назад

    Great video! Have you considered making an update, now that Syapse is GA? Meanwhile it has R, it scales and what not. Also an updated cost comparison would be nice.

    • @SQLBits
      @SQLBits  Год назад

      Hey, if you reach out to the speakers on LinkedIn/Twitter i'm sure they'll be able to answer any questions you may have!

  • @crouch.g
    @crouch.g 3 года назад +2

    I thought synapse analytics including spark went GA on 3rd Dec 2020 am I incorrect? I'm confused that you videos is only a month old?

    • @simonwhiteley8486
      @simonwhiteley8486 3 года назад +1

      This is a replay from a session around September last year - I'd take the info with a pinch of salt as it's nearly a year out of date now :)

  • @henryebube3576
    @henryebube3576 Год назад

    What has improve is Synapse?

  • @tajinderkumar7073
    @tajinderkumar7073 2 года назад +1

    Great videoo👏🏻

  • @ihafidh
    @ihafidh 6 месяцев назад

    Great comparison!
    Do a showdown between Databricks and Snowflake.

  • @concert_music
    @concert_music 2 года назад

    Wow - fab video!

    • @SQLBits
      @SQLBits  2 года назад

      Thanks so much!

  • @vishwajeetpol2495
    @vishwajeetpol2495 2 года назад

    waiting for latest release its been a year where we can see round 2. @SimonWhiteley

    • @SQLBits
      @SQLBits  2 года назад

      Hi Vishwajeet, our speakers share our updates at our live event in the UK (this year was in March) where they shared all the new information and tips on new features, and updates. Be sure to grab a ticket to the next one to see Simon live in action :D